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ABSTRACT 
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Enhanced solution techniques are developed for solving integer programs (IPs) and 
mixed-integer programs (MIPs). Previously unsolvable problems can be solved with these 
new techniques. We develop knapsack cut-finding procedures for minimal cover cuts, and 
convert existing cut-strengthening theory into practical procedures that lift and tighten vio- 
lated minimal cover valid inequalities to violated knapsack facets in polynomial time. We 
find a new class of knapsack cuts called “non-minimal cover cuts” and a method of lift- 
ing them called “deficit lifting.” Deficit lifting enables all of these cuts to be lifted and 
tightened to facets as well. Extensions of these techniques enable us to find cuts for elas- 
tic knapsack constraints and cuts for non-standard knapsack constraints. We also develop 
the new technique of “explicit-constraint branching” (ECB). ECB enables the technique of 
constraint branching to be used on IPs and MIPs that do not have the structure required for 
known “implicit-constraint branching” techniques. When these techniques are applied to 
84 randomly generated generalized assignment problems, the combination of knapsack cuts 
and explicit-constraint branching were able to solve 100% of the problems in under 1000 
CPU seconds. Explicit constraint branching alone solved 94%, and knapsack cuts solved 
93%. Standard branch and bound alone solved only 38%. The benefits of these techniques 
are also demonstrated on some real-world generalized assignment and set-partitioning prob- 
lems. 
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I. INTRODUCTION 



This dissertation develops new solution techniques, and improves existing solution 
techniques for integer programs (IPs) and mixed-integer programs (MIPs). A linear pro- 
gram (LP) minimizes or maximizes a linear objective function subject to linear constraints. 
LPs have continuous variables; restricting some of the variables in an LP to be integer re- 
sults in a MIP; restricting all variables to be integer results in an IP Mixed-integer and 
integer programs are used to model many planning problems of the military and industrial 
world such as production planning, vehicle routing and scheduling, fleet management and 
weapons system procurement. 

In the last few years, commercial solvers have dramatically improved solution times 
for large LPs, but even modest-sized IPs remain difficult to solve. As an example of com- 
parable difficulty, consider one of our test problems (denoted “DLWRD” in Chapter VI) 
which is a truck-routing problem in the petroleum industry: This IP has only 89 constraints 
and 469 variables but cannot be solved in less than 1 ,000 seconds on a fast IBM workstation 
using good, off-the-shelf technology; the corresponding LP (formed by allowing the integer 
variables of the IP to admit continuous solutions) can be solved in a fraction of a second, 
however. This disparity in solution times indicates that additional research on efficiently 
solving IPs and MIPs is warranted. 

The solution techniques developed in this dissertation are used to solve certain previ- 
ously unsolved problems. We call the combination of these techniques “ composite enumer- 
ation.” Composite enumeration combines constraint-generation and constraint-branching 
techniques within a standard (variable-based) branch-and-bound framework. These tech- 
niques will be described in greater detail later in this chapter. 

Any solution technique for MIPs developed in this dissertation will be valid for 
(pure) IPs as well. The scope of applicability will be clearly stated for each solution tech- 
nique described. To avoid repeating “IPs and MIPs,” subsequent references to “MIPs” will 
mean “IPs and MIPs” unless stated otherwise. 
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A. SOLUTION TECHNIQUES FOR MIPs 



1. Introduction 

Composite enumeration is the combination of techniques that will be used for solv- 
ing MIPs. It works within the framework of “branch and bound,” one of the two standard 
solution techniques for MIPs, but it also uses the other standard technique, “cutting planes.” 
Cutting planes are constraints that are generated and then added to the original problem 
to help solve it. Understanding these two basic techniques is essential to understanding 
the fundamentals of composite enumeration, so a brief introduction to these techniques is 
given in this section. Readers familiar with branch and bound and cutting planes may wish 
to proceed directly to section C where the specific research areas of this dissertation are 
discussed. 

To begin, we consider the following IP (most of the discussion here is valid for MIPs 
as well as IPs but clarity is enhanced by considering pure IPs only): 

2 * = min cx 

subject to: Ax = b (1.1) 

0 < x < u, x integer 

where A is an m x n matrix and the other vectors are commensurately dimensioned. The 
optimal solution to (1. 1 ) is x*, and z* = cx*. Note that this problem and its LP relaxation 
can never be unbounded since all variables are bounded above and below. Although we 
show (1. 1) with equality constraints, constraints with senses of < and > are admitted in IPs 
as well. If the vector u is a vector of all Is, then the IP is a binary IP 

Both standard branch-and-bound and cutting-plane solution procedures begin by 
solving the “LP relaxation” of the IP The LP relaxation is simply the IP with the integer 
restriction on the variables relaxed, which allows the variables to take on appropriately 
bounded continuous values. (A precise description appears in Chapter II.) The solution 
to the LP relaxation is used as a starting point for both standard branch-and-bound and 
cutting-plane solution procedures. If the LP solution is integer, the IP has also been solved. 
If not, the LP solution still provides useful information. The LP’s optimal objective function 
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Figure 1. The convex hull of integer solutions. 

value is a lower bound on the IP’s optimal objective function value, and it is a reasonable 
assumption (although not always true) that the integer optimal solution will be close to the 
LP solution. 

Before describing branch and bound, cutting planes, and an enhancement to standard 
branch and bound called “constraint branching,” a brief description of the integer polytope 
is included to introduce terminology and concepts referred to later in this chapter. 

2. Description of the Integer Polytope 

The feasible region of an IP is a lattice of integer points. The smallest polvtope that 
encompasses all feasible points of the IP is called “the convex hull of integer solutions” 
or, simply, “the convex hull.” The convex hull is a polytope with integer vertices at all 
comer points. (See Figure 1.) If the constraint set for this polytope were known for an 
IP, an application of the simplex method to the LP relaxation of the IP would lead to an 
optimal integer solution (and thus a solution to the IP), because the simplex method proceeds 
from comer point to comer point, and all comer points of the convex hull are integral. 
The individual constraints that comprise the minimal constraint set of the convex hull are 
referred to as “facets.” The set of facets for an IP is unique (e.g., Nemhauser and Wolsey, 
1988, p. 91). 



j 



Vo 




Figure 2. An enumeration tree. 

3. Branch and Bound 

The following explanation of enumeration trees, branch and bound, and the general 
branch-and-bound algorithm follows Garfinkel and Nemhauser, (1972, pp. 108-118). The 
explanation is in the context of (1.1), a minimization problem. 

a. Enumeration tree 

The branch-and-bound process is best described with an enumeration tree. 
In an enumeration tree, each node v 3 represents a problem to be solved that relates back 
to the original problem v 0 . The feasible region of Vj is the feasible region of v 0 with a 
restriction added for each branch in the path Pj from v 0 to Vj Thus, v 3 is the same as vq 
with n additional restrictions, assuming Pj has passed through n — 1 nodes between (and not 
including) t> 0 and vj. Each node has only one immediate predecessor, but may have many 
immediate successors. For example, in Figure 2, v 2 has vq as its immediate predecessor and 
has two immediate successors. The following description is of LP-based branch and bound 
for IPs, but any kind of useful relaxation of an IP may be substituted for the LP relaxation. 

Branch and bound begins at t> 0 by solving the LP relaxation of i; 0 , LP( 0). 
If the LP solution is integer, vo is solved. If not, branch and bound recursively derives sets 
of restrictions from LP solutions that define a set of IPs, vi, v 2 , .... v m such that the solution 
to at least one of these IPs solves vq. if a solution exists. Branch and bound evaluates the 
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corresponding relaxations LP( 1), LP( 2), LP(m ) to obtain lower bounds used to prove 
optimality of the solution obtained, or to prove that no solution exists. 

The process of “evaluation” at vj determines if the solution to v 3 (if it exists) 
could solve vq. The solution to LP{j) determines whether or not any subsequent IPs can 
be defined that could lead to a better solution than the best integer solution found thus far, 
called the “incumbent.” If no such IPs can be defined, Vj is said to be “fathomed.” If these 
IPs can be defined, “branching” occurs from vj. 

Branching from Vj defines new IPs that are each a different restriction of vj, 
at least one of which will solve Vj, if such a solution exists. Of course, an optimal solution 
to vj is a feasible solution to v 0 . The restrictions that define v n , v ]2 , .... Vj k , are derived from 
the solution to LP(j). These nodes are the immediate successors of v r 

“Node selection” at Vj determines the next node to be evaluated. At Vj, a 
node must be selected either (a) after the immediate successors of v 3 are defined, or (b) 
when vj is fathomed. If branching has occurred from Vj, one of vj ’ s immediate successors 
is normally selected. If Vj has been fathomed, any other node that has not been fathomed 
or branched from is selected. Such nodes are said to be “live.” Selected nodes must be 
evaluated, and the process repeats. 

Vj is fathomed when it is determined that branching from Vj will not lead to 
an optimal solution for v 0 or no improvement on the incumbent can be obtained. The three 
cases for which vj is fathomed are: 

(1) LP(j ) is infeasible. If LP(j ) is infeasible, then Vj is infeasible. 

(2) The solution to LP(j ) is integer. If the solution of LP(j) is integer, then 
any integer solution found by further branching can have no better objective function value 
than that found at Vj. (The incumbent’s objective function value, UBq, is an upper bound 
on z*. Any subsequent integer solution with a lower objective function value than UBq 
becomes the incumbent, and UBq is updated.) 

(3) The objective function value of LP(j) is greater than or equal to UBo. If 
the objective function value of LP(j ) is greater than or equal to UBq, any integer solution 
found by branching from Vj would have an objective function value greater than (worse 
than) UB 0 . 
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We examine the branching process next. We consider the problem (1.1), 
which is rewritten as 



z* — min cx s.t. x G X, 



where 



X = {x|Ax = b, 0 < x < u, x integer} . 



If we are attempting to find an x G X that minimizes z*,Vj restricts x to XjC X. The set 
Xj is defined as 

Xj= jx|A J x = b-', 0 < x < u, x integerj 

where A J x = b J is the original constraint set plus, usually, some additional constraints. 
When branching from a node, the process of “separation” determines which restrictions 
are applied to IP(j) to form the IPs represented by the immediate successors of vj. To view 
how separation might be achieved at Vj, suppose information from the solution to LP(j ) 
suggests that x* « . We consider the restrictions 0 < Xi < [yj or + 1 < Xi < 

u i: and form a set X ]+ consisting of two subsets of 

Xji = |x|A J x = b J , 0 < x < u, 0 < Xi < [yj , x integerj 
= < x|A J1 x = b jl , 0 < x < u, x integer > 



and 



L J2 



i xlA^x = b^, 0 < x < u, [yj + 1 < Xi < Ui, x integerj 
x| A J2 x = b j2 , 0 < x < u, x integerj 



so that Xjj U X J2 = Xj. In this case, as for most IPs, Aj + is a partition of Xj, but a strict 
partition is not necessary for the branch-and-bound process to converge (e.g., Garfinkel and 
Nemhauser, 1972, p.113). Although binary partitioning has been described here, partition- 
ing (and any other separation) can allow nodes to have more than two immediate successors. 

We have described the foundations of branch and bound and now provide 
the details of the complete branch-and-bound algorithm. The problem considered is 



2* = min cx s.t. x G X. 



( 1 . 2 ) 



Let 



oo ifXj = 0. 
At each node v v the restricted problem is 



* _ J cx* if x) = x solves (1.2) 

* "l 



z* — min cx s.t. x € Xj. 



(1.3) 



A lower bound LBj < z* may be calculated by considering some relaxation of (1.3) 



and letting 



z° = mincx s.t. x € RjD Xj 



r D f z°, — cx- if x? = x solves (1.4) 
LB i = \ oo ifRj = <D. 



(1-4) 



An initial upper bound UBq can be calculated by finding any x'g X, and letting UB o = 
ex'. Otherwise, UBq is initialized to oo. The feasible regions considered for the LP-based 
branch-and-bound algorithm are 

X = {x|Ax = b, 0 < x < u. x integer} , 

X.j = |x| A^x = b^, 0 < x < u, x integerj , 



and 



R j= |x|A J x = b j ,0 < x < uj 
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b. A general branch-and-bound algorithm 

The following algorithm demonstrates branch and bound for an IP: 
Branch-and-Bound Algorithm for IPs 

• Input: An IP vq{z* — min cx s.t. x € Xo) where 

Xo = {x|A°x = b°, 0 < x < u, x integer} . 

• Output: An optimal solution x* to vq, or a message that no solution exists. 

• STEP 1: (Initialization.) Let L — {v 0 } be the initial list of live nodes. 

Let UBq = oo, LBq = — oo, and Vj = vq, j = 0. Go to STEP 2. 

• STEP 2: (Evaluation.) Solve LP(j). If Rj = 0 (i.e., LP(j) is infeasible), Vj is 
fathomed (case 1) and L = L — {vj}, go to STEP 6. If LP(j ) has an optimal 
solution x°, let LBj = z° and go to STEP 3. 

• STEP 3: (Fathoming, case 2.) If x°^ Xj (i.e., x° is not integer), go to STEP 4. 
If x°e Xj, let UBj = z°, Vj is fathomed and L = L - {vj}. If UBj < UB 0 , let 
UBq — UBj and let x 7 = x°, where x 7 is the incumbent. Go to STEP 6. 

• STEP 4: (Fathoming, case 3.) If LBj > UBq, Vj is fathomed and L = L — {u,}. 
Go to STEP 6. Otherwise, go to STEP 5. 

• STEP 5: (Branching.) Choose a separation (partition) Xj + that determines the 
immediate successors of v 3 , {vj 1 ,vj 2 , Vj k } . Update the set of live nodes L = 
L — {vj} + {vj 1 ,Vj 2 , ...,Vj k }. Go to STEP 6. 

• STEP 6: (Node selection.) If L = 0, go to STEP 7. Otherwise, select a live 
node and designate it Vj. Go to STEP 2. 

• STEP 7: (Termination.) If UBq = oo, print “The IP has no feasible solution.” 
If UBq < oo, the feasible solution that yielded UBq is optimal, print the optimal 
solution x* = x 7 . 



c. An example of branching on variables 

The following is an example of branch and bound for an IP where the parti- 
tioning is achieved by “branching on variables.” This technique uses bounds on variables 
to partition the feasible region of the IP and its LP relaxation, and is the most common 
technique used to solve IPs. The solution vector for LP(j ) is denoted x° = [x), £ 2 , X3]. 
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Consider the following problem: 



Zq = minimize 5xi + 12x 2 + 3x 3 

subject to: 4x a 4- 6x 2 + > 17 

Xj € {0, 1, 2} ,j = 1, 2, 3. 



(1.5) 



The LP relaxation of the problem is 

LP( 0): Zq = minimize 5xi + 12x 2 4- 3x 3 

subject to: 4x a + 6x 2 4- x 3 > 17 (1.6) 

0 < Xj < 2 ,j = 1,2,3. 

The solution to LP( 0) is xg = [2, l|, 0], Zq =LBq = 28. Because x 2 is fractional, and 
LBq < UBo, a partition of Xo is chosen that eliminates the current fractional value of x 2 . 
The IP at each successor node is vq restricted by either 



x 2 < 1 or x 2 > 2. 



Adding the restriction x 2 < 1 to ^ forms V\, and adding the restriction x 2 > 2 to ^ forms 
v 2 . Both nodes are live, and we arbitrarily select V\ for evaluation. Attempting to solve the 
LP relaxation of v\, 

LP( 1): z° = minimize 5xi + 12x 2 + 3x 3 

subject to: 4xx + 6x 2 + x 3 > 17 „ 

x 2 < 1 (L/ ^ 

0 < Xj < 2 ,j = 1,2,3, 

we find the feasible region of LP( 1) is empty because forcing x 2 < 1 makes it impossible 
to satisfy the first constraint. Thus, V\ is fathomed (case 1). Since t/ 2 is still live, we select 
it for evaluation and solve 



LP( 2): 22 = niinimize 
subject to: 



5x! + 12 x 2 + 3x 3 
4xi + 6x 2 + x 3 > 17 

x 2 > 2 

0 < Xj < 2 ,j = 1,2,3. 



( 1 . 8 ) 



The solution to LP( 2) is = [l|, 2, 0], z° 2 =LB 2 = 30|. Because xi is fractional, 
and LB 2 < UBo, a partition of X 2 is chosen to eliminate the current fractional value of xj . 
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FATHOMED: FATHOMED: 

INTEGER EXCEEDED 

UPPER BOUN 



Figure 3. The enumeration tree for the branch-and-bound example. 

The IP at each successor node is vo restricted by either 

V ' t- 

xi < 1 or > 2 . 



Adding the restriction xj < 1 to V 2 forms 13 , and adding the restriction xj > 2 to u 2 forms 
V 4 . Both nodes are live, and we arbitrarily select V 3 for evaluation. The LP relaxation is 



LP( 3): 23 = minimize 5xi + 12x 2 + 3x 3 

subject to: 4xi + 6 x 2 + X 3 > 17 

x 2 >2 

X ] < 1 

0 < Xj < 2 ,j = 1,2,3. 



(1.9) 



The solution to LP( 3) is X 3 = [ 1 , 2 , 1 ], 23 = LB$ = 32. Because X 3 is integer, U £3 = 32, 
and since UBq = min { 00 , 32}, UB 0 is set to 32 and x 1 — X 3 , and v% is fathomed (case 2). 
The remaining live node V 4 is selected for evaluation. The LP relaxation is 



LP( 4): z° A — minimize 5xi + 12x 2 + 3 x 3 

subject to: 4xi + 6 x 2 + X 3 > 17 

^2 >2 (1.10) 

xi >2 

0 < Xj < 2 , j = 1,2,3. 



The solution to LP{ 4) is xjj = [2, 2, 0], z° A = LB 4 = 34. Because x^ is integer. UB4 = 
34, and UB 4 is compared with UB 0 , which is 32. Since UB4 > UB$, UBq remains the 
same. Because LB 4 > UBq, v a is fathomed (case 3). Since all nodes are now fathomed 
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(see Figure 3), the integer solution with the lowest objective function value is the optimal 
solution to vq. For this problem, the optimal solution was found at v% with z* = = 32 

and x* = x 7 = X 3 = [ 1 , 2, 1 ], 

When branch and bound is used on large problems, the usual goal is to obtain 
an integer solution with an objective function value that is “close enough ’ 7 to optimality. 
The use of an “optimality tolerance” precludes branching to find a solution that could only 
be marginally better than the incumbent, if such a solution exists. The absolute optimality 
tolerance is a value ABSGAP > 0 specified by the user, and a node is fathomed when it is 
guaranteed that 

UB 0 - LBj < ABSGAP . 

Implementing this amended fathoming rule in the Branch-and-Bound Algorithm for IPs is 
accomplished by replacing step 4 with: 

• STEP 4': (Fathoming, case 3.) Any node j such that LBj+ ABSGAP > UBq is 
fathomed, go to STEP 6 . Otherwise, go to STEP 5. 

Solving an IP using this fathoming rule will result in a solution that is guaranteed to be 
within ABSGAP of the best solution of the problem that could theoretically exist. 

The relative optimality tolerance is a user-specified percentage RELGAP 
> 0 ; and a node is fathomed when it is guaranteed that 

( UB 0 - LBj)/(\LBj\ + e) < RELGAP /100 

where e > 0. Note that if LBj and UBq have different signs, this procedure will not work. 
Assuming that LBj and UBq have the same signs, this amended fathoming rule can be ac- 
complished by replacing step 4 with: 

• STEP 4 ": (Fathoming, case 3.) Any node j such that ( UBo — LBj)/(\LBj \ + e) 
< RELGAP / 100 is fathomed, go to STEP 6 . Otherwise, go to STEP 5. 

Solving an IP using this fathoming rule will result in a solution that is guaranteed to be 
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Figure 4. Adding a cutting plane to the constraint set of an IR 

within RELGAP percent of the best solution of the problem that could theoretically exist. 
(A slight error due to e is possible, actually.) 

Branch and bound has been the standard way to solve integer programs since 
the early 1960s, and is credited to Land and Doig (1960). For simplicity, this technique has 
been demonstrated with an IB but this process is also applicable to MIPs. 

4. Cutting Planes 

This discussion focuses on IPs for simplicity, but cutting planes are also used with 

MIPs. 

The cutting-plane technique, more commonly referred to today as “constraint gen- 
eration,” generates additional constraints (cuts) that are appended to the constraint set of 
the original problem. These constraints must meet two criteria: (a) They must be “valid in- 
equalities” that do not eliminate any of the feasible solutions to the IP when added to the 
problem, and (b) they must cut away the current fractional (IP-infeasible) solution to the 
LP relaxation. (See Figure 4.) The goal of a cutting-plane technique is to iteratively cut 
away fractional solutions to the LP relaxations until the optimal solution to the IP is found 
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by solving the LP relaxation. 

Cutting-plane techniques fall into two general categories, techniques that depend 
on special structure in the problem (‘'structure-dependent techniques”), and techniques that 
can be applied to any IP, independent of the problem structure (“structure-independent tech- 
niques”). 

Examples of structure-dependent techniques include methods for generating valid- 
inequalities from the set packing polytope (Padberg, 1973), from the knapsack polytope 
(Padberg 1975), and from the set covering polytope (Comuejols and Sassano, 1989). Struc- 
ture-dependent techniques are relatively easy to implement, but usually cannot guarantee 
convergence of the cutting-plane technique because they do not derive cuts from the prob- 
lem’s complete constraint set. This dissertation uses cuts derived from the knapsack poly- 
tope because knapsack constraints frequently appear in IPs and are fairly easy to find and 
exploit. 

Structure-independent cutting-plane techniques include Gomory cuts (Gomory, 
1958), Dantzig cuts (Dantzig, 1959) and the Chvatal-Gomory rounding method (Chva- 
tal, 1 973). Many of these techniques have finite (convergent) algorithms associated with 
them. Although initial computational experience with structure-independent techniques 
was disappointing, more recent research on lift-and-project cuts (Balas, Ceria, and Cor- 
nuejols, 1993) and Chvatal-Gomory cuts (Caprara and Fischetti, 1996) has been more suc- 
cessful. Our initial experience with a structure-independent cutting-plane technique was 
disappointing, as the computational overhead proved to be significant. Because of this, this 
dissertation does not consider structure-independent constraint-generation techniques for 
composite enumeration. This is an area for future research. 

On large problems, cutting planes alone have not usually been successful in ob- 
taining integer solutions, but the combination of cutting planes with other techniques con- 
tinues to produce new solution methodologies for MIPs. Crowder, et al.(1983) combine 
preprocessing, cutting planes, and a modification of branch and bound to solve large binary' 
IPs. Johnson, et al. (1985) combine preprocessing, coefficient reduction, cutting planes and 
a modification of branch and bound to solve large-scale binary planning models. 

Another combination of techniques called “branch and cut” adds cuts during the 
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branch-and-bound process. It has been used successfully to solve large MIPs with special 
structure (Padberg and Rinaldi, 1991, Hoffman and Padberg, 1991, 1993, Balas, Ceria, and 
Comuejols, 1996). The cuts are generated from the solution of an LP at a node within the 
branch-and-bound enumeration tree. These cuts can be either “globally valid” or “locally 
valid.” Globally valid cuts, such as the polyhedral cuts used by Hoffman and Padberg 
(1993), are cuts that are valid for any node in the enumeration tree. Locally valid cuts 
are cuts generated from the restricted LP at a particular node that are only valid for that 
node and any of its successors. Gomory cuts and knapsack cuts are examples of cuts that 
are locally valid when generated from the restricted LPs. The knapsack cuts developed in 
this dissertation could be used in a branch-and-cut framework, but we leave this for future 
research. We only apply knapsack cuts before the start of branch and bound, where they are 
globally valid. 

Example 1. This example demonstrates a simple cutting-plane technique for MIPs with 
“knapsack constraints.” A pure IP is used for illustration here, but the technique is equally 
valid for MIPs containing binary knapsack constraints. This technique is formalized in 
Chapter III, and is the primary cutting-plane technique used in this dissertation. The solution 
vector for LP(j) is denoted x° = [xj, x 2 , x 3 , x 4 ], and z° is the objective function value 
for LP(j). 

Consider the problem: 

Zq = maximize 10xi + 12x 2 + 15x 3 + x 4 

subject to: 3x 4 + 4x 2 + 7x 3 + x 4 < 12 (1.11) 

Xj e {0, 1} j = 1,2, 3, 4. 

This problem is a binary “knapsack problem” (e.g., Garfinkel andNemhauser, 1972, pp. 13- 
14). The solution to the LP relaxation of (1.11) is xj = 1, x 2 = 1, x 3 = x 4 = 0, 
Zq = 32|. By considering the knapsack constraint 

3xj 4 - 4x 2 + 7x 3 + x 4 < 12, (1.12) 

and the LP solution of (1. 11), it is clear that the three variables that were positive in the 
solution to the LP relaxation cannot all be set to 1, since this would violate (1.12). An 
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inequality that expresses this statement is 



X! + X2 + x 3 <2. (1.13) 

Because this inequality does not eliminate any valid solutions to (1. 11), it is a “valid in- 
equality” for the IR Because 

Xj -i- X2 + x 3 > 2. 

the valid inequality (1.13) is violated by the fractional solution to the LP relaxation, so (1.13) 
is also a “cut.” By appending (1.13) to (1.11), a new IP is formed: 

z\ = maximize 10xj + 12x2 + 15x 3 + X4 

subject to: 3xi + 4x2+ 7x 3 + x 4 < 12 

• Xi + X2 + x 3 <2 ' 

x 3 € {0,1} j = 1.2, 3, 4. 

The solution to the first LP relaxation, x\ = 1, X2 = 1, x 3 = I. x 4 = 0, has been cut off by 
the cutting plane x\ + X2 + x 3 < 2, and is now infeasible to the LP relaxation of (1.14). The 

solution to the LP relaxation of(1. 14) is an integer solution xi = 0, X2 = 1, x 3 = 1, x 4 = 1, 

z° = z\ = 28, and the problem is solved. 

End example 1. 

5. Constraint Branching 

Since its inception, there has been a quest to improve the process of branch and 
bound. Branch-and-cut techniques seek to improve the process by using cutting planes. 
Constraint branching takes a different approach. First, consider variable-based branch and 
bound for MIPs. It partitions the feasible region of the MIP by branching on single integer 
variables. For instance, if 

k < xj < k + 1 

for some integer k. the branching choices are 

Xj < k or Xj > k + 1. 

This often creates an unbalanced enumeration tree, especially in the case of binary variables. 
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(We explain the concept of “balance” in the next section.) If we could discover a bounded 
relationship involving a set of variables, such as 
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where all a 3 as well as k are integer, we could partition the IP’s feasible region with re- 
spect to the entire expression ^ a j x j- This technique has the potential to create a bet- 



ter balanced enumeration tree. The choice for “constraint branching” might consider the 
branching choices 



Certain applications of this technique have proven to be much more effective than variable- 
based branch and bound for problems with special structure. 

Beale and Tomlin (1973) developed the first application of constraint branching 
using “special ordered sets.” Special ordered sets (SOS) are sets of variables within ex- 
isting constraints that share a common property. For example, the set of variables in a 
set-partitioning constraint (^ x 3 — 1, x 3 binary for all j € ./,) share the Type 1 SOS 



property that at most one of the variables in the set can be non-zero. Partitioning with SOS 
is achieved using the solution values from the LP relaxation and the user-implied ordering 
of the variables. This information is used to define subsets of the variables that determine 
the restrictions for each new IP formed. The actual restriction is accomplished logically, 
without adding any new constraints to the MIPs formed at the subsequent nodes. SOS is 
discussed in more detail in the next section. 

The “implicit-constraint- branching” approach of SOS is an efficient technique, since 
explicitly adding constraints and/or variables to a problem can make the problem more com- 
putationally difficult. Although Beale and Tomlin recognized two special ordered sets, most 
MIP solution software packages today also include a third type of special ordered set (e.g., 
CPLEX, 1993, pp. 71-73). Foster and Ryan (1981) recognize a relationship between sets 
of variables in overlapping set-partitioning constraints and develop an implicit-constraint- 
branching technique for problems with this property. 

One limitation of implicit-constraint branching is that it can only be used when 
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special structure exists somewhere in a MIR Adding additional structure to a MIP allows 
another type of constraint branching called “explicit-constraint branching” (suggested by 
Wood, 1 994) that has proven useful for certain classes of problems. This technique adds 
structure, constraints and variables, to facilitate the branch-and-bound process. Our results 
in Chapter VI show that the increased difficulty resulting from the added structure is often 
outweighed by a reduction in the size of the enumeration tree. This technique is outlined in 
section C.3. 



a. Implicit-constraint branching 

To illustrate why constraint branching might be preferred to variable branch- 
ing, we discuss an example of implicit-constraint branching with SOS variables. 

Assume a MIR vq. has q “set- partitioning constraints” of the form 

^ ! x j ~ 
jeJi 

where the x 3 are binary variables, J is the set of all variables in the problem, J, C J, 
and i = 1, ..., q. We are at v 0 of the branch-and-bound tree, and have solved the LP relax- 
ation of vo, LP( 0). Each set of variables Xj, j e J,, i — 1, ..., q is an example of an SOS 
of “Type 1,” which is a set of variables of which at most one variable may be non- zero 
(e.g.,CPLEX, 1993, p.72). We first examine the values of the variables in the solution to 
LP( 0). If all integer variables have integer values, uo is solved. Suppose not, and suppose 
that set-partitioning constraint p has “fractional variables,” i.e., variables with fractional 
LP solution values. The set of variables J p in the constraint is then partitioned into two 
disjoint subsets, J* and J p +l , each containing one or more fractional variables. (The user- 
specified ordering of the variables also influences the composition of the subsets.) v 0 will 
be restricted by either 

Y Xj = 1 or Y x i = 1- 

jej £ +1 
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Figure 5. Implicit-constraint branching. Partitioning at V 2 is achieved by forming two disjoint subsets Jp and Jp such 
that J* = J 3 U Jp. 

Those restrictions are equivalent to 

Xj < 0 or Xj < 0. (1.15) 

Instead of adding the appropriate constraint to uo> implicit-constraint branching is carried 
out logically. If from uo we select v x , the first restriction in (1.15) is implicitly added to vq 
by setting xj = 0 for all j 6 Jp. If we select V 2 , the second restriction in (1.15) is implicitly 
added to uo by setting Xj = 0 for all j <E Jp +1 . Because no constraints are actually added 
to the problem, this is an implicit-constraint-branching technique. (See Figure 5.) 

Intuitively, this constraint-branching procedure is preferred to variable-based branch 
and bound because it eliminates the unbalanced decisions that are made by branching on 
single binary variables. The variable-based branch-and-bound algorithm must choose a 
variable to branch on. Setting the variable to 0 is a weak decision, since all the variables in 
a set-partitioning constraint except one are set to 0 in the final solution anyway. Setting a 
variable to 1 is a strong decision, because it forces all other variables in the constraint to be 
set to 0. 

The SOS technique makes a choice that moderates the “strength” of the 
decision made. Branching to a subsequent node restricts all the variables in one subset to 0, 
and allows any combination of the variables in the other subset to sum to 1 . As the branching 
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progresses, the “strong” decision of setting a particular variable to one is delayed, while 
unpromising variables are culled out of the unrestricted “sum to 1 ” subset and placed in the 
new “set to 0” subset. Once an integer solution is found, other partitions are explored using 
different subsets, and the process progresses in the same manner. Favorable computational 
results using SOS are reported by Crowder, et al. (1983) and Hummeltenberg (1984). 

We call any enumeration technique for IPs that partitions the feasible region 
sufficiently to guarantee convergence a “complete” enumeration technique. SOS Type 1 is 
an example of a complete enumeration technique when all variables fall into at least one 
set-partitioning constraint. Enumeration techniques that cannot guarantee convergence are 
called “incomplete.” Our basic explicit-constraint-branching technique (outlined in section 
C.3) is an example of an incomplete enumeration technique: It must revert to variable-based 
branch and bound on the problem’s original variables to guarantee convergence. 

b. Generalized branching 

“Generalized branching” is a relatively new term. In a generic context, it 
refers to all branching techniques other than standard variable-based branch and bound. 
Techniques such as implicit-constraint branching, our explicit-constraint branching, and 
some branch-and-price techniques (e.g., Sol, 1994) are generalized branching techniques. 
Jomsten and Larsson (1988) develop a technique they call “generalized branching” which, 
as described in Jomsten and Varbrand (1991), adds branching constraints at nodes of the 
branch and bound process. 

B. ORGANIZATION 

This dissertation is organized as follows: 

• The remaining sections of this chapter summarize the key results developed in 
this dissertation. These results include computationally efficient procedures for 
deriving a violated knapsack facet from an individual knapsack constraint, a new 
class of knapsack cuts, and a new branching technique called “explicit-constraint 
branching” that improves branch-and-bound performance. 

• Chapter II provides definitions and other preliminary material. 
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• Chapter III develops two cut-generation techniques for standard knapsack con- 
straints, lifting and tightening techniques that guarantee the creation of stronger 
cuts from those originally generated, and a new class of knapsack cuts. 

• Chapter IV develops a cut-generation technique for elastic knapsack constraints 
and transformations that allow cut generation for non-standard knapsack con- 
straints. 

• Chapter V develops the technique of explicit-constraint branching. 

• Chapter VI outlines results of composite enumeration as applied to a series of test 
problems including modified and standard Generalized Assignment Problems 
(GAPs). 

• Chapter VII summarizes completed research. 

C. ENHANCED SOLUTION TECHNIQUES FOR MIPs 



1. Introduction 

We will show that combining cutting planes derived from individual knapsack con- 
straints with an explicit-constraint branching technique (discussed in section C.3) produces 
remarkable computational results. While knapsack cuts alone rarely solve previously un- 
solvable MIPs, our research shows that the combination of knapsack cuts with explicit- 
constraint branching solves MIPs that cannot be solved in a practical amount of computing 
time by either of the two techniques applied in isolation. The use of knapsack cuts makes 
intuitive sense, and they are easy to exploit. The knapsack structure is commonly found in 
many real-world problems. 

2. Cutting Planes from the 0-1 Knapsack Polytope 



a. 



Knapsack facets 



A constraint of the form 




jeJ, 
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where a 3 and b are positive integers, x 3 are binary variables, and J, C J is commonly re- 
ferred to as a “knapsack constraint.” Knapsack constraints are often used to model con- 
sumption of limited resources, where b represents the amount of resource available and 
a,j represents the amount of resource that will be consumed if the variable representing a 
resource-consuming process x 3 is activated by setting x 3 = 1. 

One of the key results of this dissertation is a cutting-plane technique for a 
knapsack constraint that finds a maximally violated “minimal cover cut,” (e.g., Balas and 
Zemel, 1978) if one exists, and then lifts and tightens the cut to a facet of the knapsack 
polytope, all in pseudo-polynomial time. We first require a feasible solution to the LP 
relaxation of the MIR To be a candidate for a cutting-plane technique, a knapsack constraint 
must have at least one variable with a fractional LP solution value. For these candidates, we 
find a maximally violated minimal cover cut, if one exists, in pseudo-polynomial time by 
using dynamic programming; this requires that the coefficients and the right-hand side of the 
knapsack constraint be integer. Then, a procedure that combines “lifting” and “tightening” 
creates a facet from the minimal cover cut in polynomial time. The combination of the two 
procedures is a technique that finds a maximally violated facet of the knapsack polytope 
in pseudo-polynomial time. A new cut-finding procedure for a knapsack constraint finds a 
“non-minimal cover cut” if one exists but no minimal cover cut does. A similar lifting and 
tightening procedure creates a knapsack facet from this cut as well. Results are extended 
to elastic knapsack constraints and knapsack constraints with greater-than-or equal-to and 
equality senses. (Chapter II provides the definitions of “lifting,” “tightening,” “minimal 
cover” and “minimal cover cut.”) 

As with most cutting-plane techniques that rely on limited special structure, 
these techniques are not convergent. That is, they will not generate cuts that define the 
convex hull of the MIP in enough detail to solve the MIP. This is true because knapsack 
facets are derived from individual knapsack constraints, and thus are facets of the knapsack 
polytope, but are not usually facets of the MIP’s polytope. Nonetheless, these knapsack cuts 
enable other branching techniques to work more quickly and efficiently. Knapsack cuts are 
derived in Chapter III. 

The properties of the knapsack polytope have been explored in the literature 
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for over 20 years. Our research builds on results found in the seminal papers of Padberg, 
Balas, and Zemel. Padberg’s method for lifting a minimal cover valid inequality to a facet 
(1975) is a key result that has laid the groundwork for many other knapsack results. From 
Padberg’s result, Balas (1975) develops necessary and sufficient conditions for classes of 
inequalities to define facets of the knapsack polytope. Balas and Zemel identify the class 
of all facets associated with minimal covers for a knapsack polytope (1978). Padbeig’s 
knapsack result is applied to help solve large-scale binary IPs by Crowder, Johnson, and 
Padberg (1983). Zemel (1989) develops a method to lift a minimal cover valid inequality to 
a facet in polynomial time. Research continues today with Boyd’s recent papers on Fenchel 
cutting planes, which are cuts for the knapsack polyhedron (Boyd, 1992, 1994). 

b. Computational complexity 

Any cutting-plane technique developed for use on practical problems must 
be computationally tractable. Computational experience has shown knapsack cuts to be 
useful for reducing variable-based branch and bound enumeration (Crowder et ah, 1983), 
but the additional constraints generated must be more useful than the computational over- 
head added by the actual process of generating the cuts. The emphasis on computational 
complexity is demonstrated by the following excerpt from a paper on knapsack cuts: 

...it is not clear that given a minimal cover from which a violated facet can be 
generated by lifting and complementing that such a facet can be generated 
in pseudo-polynomial time (the polynomial time lifting theorem of Zemel 
guarantees a facet, not a violated facet). (Boyd, 1992) 

The lifting and tightening methodology we develop for minimal cover cuts 
lifts and tightens a minimal cover cut to a violated facet in polynomial time. 

c. Cuts for elastic knapsack constraints 

An elastic constraint is a constraint from a MIP that has been transformed by 
the addition of one or more variables that allow penalized violation of the constraint. The 
penalty is applied by adding each elastic variable to the objective function with some coef- 
ficient p that represents the cost per unit of violation. Elastic constraints occur frequently 
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in LPs and MIPs (e.g., Brown and Graves, 1981). While any constraint can be made elas- 
tic, knapsack constraints are prime candidates for “elasticizing.” Consider the knapsack 
constraint 

a j x j < b - (1.16) 

i&Ji 

We create an elastic knapsack constraint from (1.16) by adding an elastic variable z > 0 : 

a,jXj — z < b. 

jeJi 

The variable 2 represents the additional units of resource that can be used above and beyond 
the basic limit of b if an appropriate (linear) penalty is paid. The variable 2 may or may not 
be explicitly bounded. 

Our research extends the basic knapsack cut results to derive cuts from elas- 
tic knapsack constraints. This new result (Chapter III) allows the use of knapsack cutting 
planes on the Generalized Generalized Assignment Problem (GGAP), an extension of the 
GAP that uses elastic knapsack constraints. The GGAP is described in Chapter II. 

3. Explicit-Constraint Branching 

“Explicit-constraint branching” (ECB) is a new technique that allows the benefits of 
constraint branching for problems lacking the special structure required of known implicit- 
constraint-branching techniques. This new technique is remarkable because the combina- 
tion of variable-based branch and bound and ECB solves MIPs that variable-based branch 
and bound alone cannot solve. When knapsack cuts are added to this combination, the per- 
formance is often better yet. 

The constraints and general integer variables that ECB adds to a MIP facilitate 
variable-based branch and bound. This may sound counterintuitive, but a simple exam- 
ple illustrates why this technique has merit. 

Example 2. Consider the binary IP (the problem is trivial, but serves to highlight the ben- 
efits of ECB on even small problems) 
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maximize Y Xj 

j€J 

subject to: Y 2 x j < 2 

jeJ 



M 

2 



+ 1 



Xj 6 



{0,1} Vj € J. 



The LP relaxation has an extreme point solution with 



\J\ 

2 



of the variables equal to 1, 



variable equal to .5, and the other | J\ — 



2 



— 1 variables equal to 0. Variable-based branch 
and bound forms a partition based on the one fractional variable, which we designate as xf, 
and derives the restrictions 



Xf<0OTXf>l. 

Each subsequent LP relaxation solved at a node of the enumeration tree has one of the re- 
maining unfixed variables fractional, until the last variable is fixed by branch and bound, 
and an integer solution is finally obtained. Although this integer solution is an optimal so- 
lution, the bounding information is not sufficient to fathom other live nodes, so another live 
node is selected, and after a similar lengthy path around the enumeration tree fixing frac- 
tional variables at each node, another (alternate) optimal solution is found. This exhaustive 
process continues until all (^jjjj) alternate optimal solutions are enumerated. 

We employ constraint branching on this problem to reduce the number of nodes 
branch and bound must enumerate. By adding an additional variable y, called a “branching 
variable,” and a constraint (redundant to the IP) of the form 



^ Xj - y = 0, 
j€J 



we form the modified problem 



maximize Y x j 
] eJ 

subject to: Y^ x i 

jeJ 

E X 3 

jeJ 



-y 

y 



< 




+ 1 



€ {0,l}Vj€J 

€ {0, 1, 2, ..., | J|} . 



The LP relaxation solves exactly as before for the Xj, and the branching variable y is equal to 
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Ml 

2 



+ .5. The variable-based branch and bound partition based on y derives the restrictions 



y< 



\J\ 




\J\ 


2 _ 


or y > 


_ 2 _ 



+ 1. 



The second restriction is infeasible, and the first yields an LP relaxation with optimal ex- 
treme points. Variable-based branch and bound, using the simplex algorithm to solve the 
LP relaxations, requires only three nodes to solve this problem. 

End Example 2. 

In general, the application of explicit-constraint branching adds a constraint 



^2 - y = o 

jef 

where j C J, and J is the set of indices of all integer variables of the problem. ECB 
constraints can be added for any set of integer variables of a MIP, but the sets of variables 
used to form ECB constraints must be intelligently chosen if computational improvements 
are to be realized. ECB constraints are discussed in Chapter V. 

The next chapter defines the key terms and introduces the notation that will be used 
throughout the rest of the dissertation. 
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II. PRELIMINARIES 



This chapter defines key terms used in subsequent chapters. This chapter also gives 
formulations for the IPs that are used for computational testing of the solution techniques 
developed in the dissertation. 

A. DEFINITIONS 
1. General 

The notation in this section follows Balas and Zemel (1978). Most of the definitions 
are standard, but a good reference for them is Nemhauser and Wolsey (1988). 

• The knapsack problem is a binary integer program that maximizes the sum of the 
utility of the items that can be carried in a knapsack with limited carrying capacity. 
For the purpose of illustration, it is assumed that there is a single constraint on 
the total weight that the knapsack can carry. The problem can be formulated as: 

Indices: 

j G N items that can be placed in the in the knapsack. 

Given data: 

Cj utility of item j. 
a,j weight of item j. 
b total weight the knapsack can carry. 

Decision variables: 

Xj 1 if item j is placed in the knapsack; 0 otherwise. 

Formulation: 

maximize c j x j 

j€N 

subject to: ^2 a i x j — & (H I) 

je N 

x j € {0, 1} V j € N. 

NOTE: The version of the knapsack problem where the Xj are general integer variables is 
not considered in this dissertation. 

• The LP relaxation of an integer program IP{ 0) is an LR LP( 0), which is identical 
to IP{ 0) except that integer variables are replaced with appropriately bounded 
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continuous variables. For example, the LP relaxation of the knapsack problem 
(II.l) is 

maximize ^ c j x j 

j£N 

subject to: 22 dr j x j ^ b 

j£N 

o < Xj < iv j e N. 

• The knapsack inequality is 

J2 w ^ b > ( IL2 ) 

j£N 

where a,j and b are positive integers, Xj are binary variables, and TV = {l,...,n}. 

• The integer polytope P associated with a general integer program is the convex 
hull of points that satisfy 

P = conv {x e Z n \ Ax < b, Dx = d} , (II.3) 

where Ax < b represents all inequalities, and Dx = d represents all equalities 
in the constraint set of the general IP (see Figure 1). 

• The points x 1 , ..., x fc e R n are linearly independent if the unique solution of 

k 

22 Ape 1 = 0 is Aj = 0 for i =1, ..., k. 

i— 1 

• The points x 1 , .... x fc € R n are affinely independent if the unique solution of 

k k 

Y2 AiX z = 0, Ai = 0 is Aj = 0 for i =1, ..., k. 

i=l i=l 

• The following statements are equivalent: 

a. x 1 , ..., x fc 6 R n are affinely independent. 

b. x 2 — x 1 , x 3 — x 1 , ..., x fc — x 1 are linearly independent. 

• The dimension of a polytope P is k if the maximum number of affinely indepen- 
dent points in P is k + 1. 

• The knapsack polytope P associated with (II.2) is the convex hull of 0-1 points 
that satisfy (II. 2): 



P = conv < x G {0, l} n a.jXj < b > . (H-4) 

( jeN ) 

(This is just a special case of (II. 3) where the variables are binary and the con- 
straint set consists of one knapsack constraint.) 

Assumption 1 : It is assumed that the dimension for the knapsack polytope P is 
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d = n, which is true if and only if a : < 6, V j e N (Balas and Zemel, 1978). 

• A facet of the integer polytope P (II. 4) is an inequality of the form 

- UJ ° (IL5) 

jeN 

that is satisfied by every x € P, and satisfied at equality by exactly d affinely 
independent points x € P, where d is the dimension of P. 

• A valid inequality for an IP is an inequality of the form 

53 - w o (II. 6) 

jes cn 

which, when added to the constraint set of the IP, does not exclude any feasible 
solution to the IP 

• A cut for an IP is a valid inequality that, when added to the IR eliminates some 
fractional solution x to the LP relaxation of the IP The valid inequality (II. 6) is 
also a cut if 



53 u>jXj > ujq. 

j£S 

(Cuts are also referred to as “violated valid inequalities,” where the violation is 

Z) u j x j ~ w o) 
jes 



2. Lifting and Tightening Valid Inequalities 

The two processes of lifting and tightening a valid inequality are used throughout 
the literature on constraint generation, but their definitions often differ between papers. For 
the purposes of this dissertation, we will make a clear differentiation between the two terms. 

• Lifting is the process of extending a valid inequality for an IP to include as many 
additional variables as possible without eliminating any feasible integer solu- 
tions. Every variable that is added to (lifted into) the valid inequality may enable 
the extended valid inequality to eliminate more of the feasible region associated 
with the LP relaxation of the IP For example, suppose that by some means an 
initial valid inequality 



x\ + X 2 + £3 < 2 (II-7) 

is obtained for the following knapsack problem: 
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maximize 10x! + 12^2 + 15x3 + 9x 4 
subject to: 3xj + 4x2+ 7x3 + 10x 4 < 12 

Xj € {0,1}, j = 1,2, 3, 4. 

The valid inequality (II. 7) indicates that at most two of the variables xj, j = 
1 , 2, 3, may be set to 1 without violating the knapsack constraint. One lifting 
process (called “simple lifting” in this dissertation) extends the valid inequality to 
include all variables that have constraint coefficients greater than or equal to the 
largest constraint coefficient of the variables in the valid inequality. Since the co- 
efficient on x 4 is greater than the maximum of the coefficients on Xj, j = 1, 2, 3, 
the valid inequality (II. 7) may be lifted (extended) by including the variable x 4 : 

Xi + X2 + X3 + X 4 < 2. 



• The process of tightening a less-than-or-equal-to valid inequality increases the 
coefficients of the variables from their current value to a higher integer value if 
it can be done without eliminating any feasible integer solutions. A continuation 
of the lifting example demonstrates this, using the valid inequality 

Xi + X2 + X3 + X 4 < 2 . 



If x 4 is set to 1, no other variable in the valid inequality can be set to 1 without 
violating the knapsack constraint. Thus, x 4 can be assigned a coefficient of 2 
without excluding any valid solutions, and the tightened valid inequality is 

Xj + X2 + X3 + 2 x 4 ^ 2. 



3. Covers and Cover Cuts 

All definitions in this section refer to the knapsack inequality (II. 2) and the associ- 
ated knapsack polytope P (II.4). 

• A cover is a set S C N such that 

b - 

jes 
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• A minimal cover S is a cover such that 



a.j < b, V i € S. 

jes-{i} 

• A minimal cover valid inequality is a valid inequality that corresponds to the 
minimal cover S : 

< |S| - 1. (11.8) 

• The extension of S (to N) is defined as E(S ) = S U S, where 

S = {i € N - S | ai > aj V j e 5} . 

• An extended minimal cover valid inequality is a valid inequality that corresponds 
to extension of S : 

E x i - l 5 l ~ L 

J€E(S) 

• A minimal cover cut is a minimal cover valid inequality for which 

£ % > |S| - 1 (II.9) 

jeS 

where S', is the 7th component of x, the solution vector of the LP relaxation of 
the MIR 

• A lifted minimal cover cut is a minimal cover valid inequality for the minimal 
cover S extended from (II. 9) for which 

E *;> i 5 i _ L 

ieE(S) 

• A strong cover S' is a minimal cover for which either 





E(S') = N 


or 


E a i + a * ma * - ^ 




j€S f — {jmax} 


where 


Jmax =argmax cij 




j€S f 


and 


a ; v = max a* 
n " x i€N-E{S') 
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• A tight strong cover is a strong cover S' such that 

^2 a j~b = 1. 

jes 1 

• A strong cover valid inequality is a minimal cover valid inequality (II. 8) based 
on the strong cover S': 

< IS'I - 1. 

j€S r 

• A strong cover cut is a lifted strong cover valid inequality: 

Xj < |s'| - i. 

jeE(S') 

Note that the strong cover cut must be a lifted strong cover valid inequality to 
ensure the valid inequality is violated. (This is explained in more detail in Chapter 

in.) 

B. TEST PROBLEMS 

This section gives the formulations for the test problems that will be used to evaluate 
the effectiveness of the computational techniques developed in this dissertation. 

1. The Generalized Assignment Problem 

One type of IP used for testing is the Generalized Assignment Problem (GAP). This 
problem arises in a number of contexts (e.g., Amini and Racer 1994, Ross and Soland 1975) 
but is described here as a minimum cost assignment of orders to trucks. Each order must 
be delivered, and the number of orders any truck can deliver is constrained by the amount 
of time the truck has available to make deliveries. It is assumed that deliveries are made 
from a single depot and that each order o requires one out-and-back trip of known duration. 
Any order may remain undelivered although a large penalty cost will be incurred if this 
happens. For notational convenience, each non-delivery is modeled as a delivery by a high- 
cost phantom truck t that could deliver all orders by itself. Actual data from the petroleum 
industry and a set of randomly generated GAPs will be used for tests. All data is integer 
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except for costs and penalties. 



Indices: 

o G O is the set of orders to be delivered, 
t € T is the set of trucks that can make the deliveries, 

O t is the set of orders that truck t is capable of delivering, 

T 0 is the set of trucks with which order o can be delivered. 

Given data: 

c ot is the cost of delivering order o with truck t, and 

h ot are the hours (in tenths) required by truck t to deliver order o, 

H t are the hours (in tenths) available on truck /, H t > = oo. 

Decision variables: 

x 0 t is 1 if order o is delivered by truck t, and is 0 otherwise. 



Formulation: 



minimize £ c 0t x 0 t 

oeO 

subject to: x °t = 


1 


Vo 


G 


0 


(ORDERS) 


t eT 0 

yi hotxot ^ 


H t 


Vi 


G 


T 


(TRUCK-HOURS) 


o€O t 

Xot £ 


{0,1} 


Vo 


G 


0 1 t G T 0 . 





2. The Generalized Generalized Assignment Problem 

This dissertation also considers the generalization of the GAP (GGAP) with elastic 
truck hour constraints. These constraints allow penalized overtime on each truck. 

Indices: Same as GAR 



Given data: Same as GAP with these additions: 

H t is the maximum number of regular time hours (in tenths) that truck t may operate, 
H[ is the maximum number of overtime hours (in tenths) that truck t may operate, 

Decision variables: Same as GAP with these additions: 
yf overtime hours (in tenths) for truck t 



Formulation: 



minimize E c ot%ot + E vt z t 

oeo ter teT 

subject to: ^2 x ot = 

teTo 

E h ot x ot -z t + < 

oeo t 

X 0 t € 

4 € 



1 Vo € O 

H t Vt e T 

{0,1} Vo € O, 

|0, 1, .... if/} Vi € T 



Note that two-sided elastic constraints can also be used to penalize under-utilization of 
trucks. 
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III. KNAPSACK CUTS 



We use knapsack cutting planes in composite enumeration because knapsack con- 
straints occur often in IPs, they are relatively easy to work with, and their valid inequalities 
and cuts have been extensively studied in the literature. Despite extensive study, effec- 
tive and efficient procedures to find and apply knapsack cuts have been lacking. In this 
chapter, we develop new techniques for finding and lifting cuts from individual knapsack 
constraints. We describe an algorithm that finds a maximally violated minimal cover cut 
for a knapsack constraint if such a cut exists, an algorithm that lifts a minimal cover cut 
to a lifted minimal cover cut and we develop a new lifting procedure called “interior lift- 
ing” that lifts a lifted minimal cover cut to a strong cover cut (a lifted strong cover valid 
inequality). We adapt polynomial-time facet-finding algorithms to tighten strong cover cuts 
to violated facets, identifying conditions and creating procedures that streamline the facet- 
finding process. 

We identify a new type of knapsack cut, the “non-minimal cover cut,” a cut that can- 
not be found by solving the traditional minimal cover separation problem (e.g., Crowder, et 
al. 1983). We develop non-minimal cover cut-finding procedures and a new lifting proce- 
dure called “deficit lifting.” Deficit lifting creates a violated extended minimal cover valid 
inequality from a non-minimal cover cut, if necessary. All non-minimal cover cuts can be 
lifted and tightened to facets in polynomial time. The complete procedure of cut-finding, 
lifting and tightening for either a minimal or non-minimal cover cut produces a violated 
facet in pseudo-polynomial time. 

A. FINDING A MINIMAL COVER CUT 

All cutting planes for MIPs must meet two criteria: (a) They must be valid inequali- 
ties that do not eliminate any of the feasible solutions to the MIP when added to the problem, 
and (b) they must cut away x, the current fractional (MIP-infeasible) solution to the LP re- 
laxation. We focus on the minimal cover valid inequality (MCVI) because it has been the 
foundation of many of the important results concerning the knapsack polytope. In particular, 
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an MCVI can always be lifted and tightened to a facet of its associated knapsack polytope. 
Because we seek an MCVI that is also a cut, we want a violated MCVI which we call a 
“minimal cover cut” (MCC). Two conditions must be satisfied before attempting to find an 
MCC. First, the solution to the LP relaxation x must be fractional. Second, the knapsack 
constraint that we will generate cuts from must have at least one Xj fractional. If those two 
conditions are met, we attempt to find an MCC for the candidate constraint. Because we 
want any facet generated through our lifting and tightening algorithms to have the largest 
violation possible, we begin the facet-generation process by finding an MCC that is maxi- 
mally violated, and if found, call it a “maximally violated minimal cover cut” (XVMCC). 
We describe the XVMCC-finding problem next, and outline an algorithm for its solution. 

1. Maximally Violated Minimal Cover Cut-Finding Problem 

We solve the XVMCC-finding problem with dynamic programming, which requires 
that the knapsack constraint have integral data. Before formulating the cut-finding problem, 
we review the pertinent definitions. 

Recall that the knapsack constraint is defined as 



where aj and b are positive integers, a,j < b V j € N, Xj are binary variables, and N — 
{1, ..., n}. A cover for (III. 1 ) is a set 5 C N such that 




(III.l) 



j€JV 




(III.2) 



and a minimal cover S' is a cover such that 




(HI-3) 



j€S-{i} 



The MCVI is written as 
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2 . 



Cut-Finding Problem Formulation 



In order to find an XVMCC, we must identify a knapsack constraint of the MIP that 
has at least one variable with a fractional LP solution value Xj. Once a suitable constraint 
is found, we solve the following cut-finding problem: 

Indices: 

j e N = {1, 2, 3, ...n} variable index for the knapsack constraint 
N + = { j € N | Xj > 0} where x is the solution of the LP relaxation of the MIP 

Given data: 

£j value for Xj in a solution of the LP relaxation of the MIP 
cij knapsack constraint coefficient of Xj 
b right-hand side of the knapsack constraint 



Decision variables: 

hj 1 , if xj is placed in the minimal cover inequality; 0 otherwise 
r a general integer variable that becomes the right-hand side of the XVMCC 

Formulation: 



maximize 



5Z 


hj — r 






(III.4a) 


jeN+ 










■■ X 


jhj 


> 


6+1 


(III.4b) 


j£N+ 










x» 


jhj 


< 


6 + fl m j n 


(111.4c) 


j£N+ 










X 


hj — r 


= 


1 


(III.4d) 


j£N+ 












hj 


G 


{0, 1} V j € N + 






r 


G 


{0, 1, 2, \N + \ — l} , 





where a m i n = min a^. 

je N+ 

The following list explains the relationship of the constraints to the minimal cover 
cut that we seek. 

(1) Constraint (III.4b) ensures that the right-hand side of the constraint is covered 
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as required by (III. 2): 



ajhj >6 + 1 <=> E ajhj > 6. 

j€N+ j£N+ 

(2) Constraint (III. 4c) ensures that the cover is minimal as required by (III. 3). If the 
right-hand side is no longer covered when the element with the minimum coefficient in the 
cover is removed, it will not be covered if any other aj > a min , j E N + is removed: 

^ ' Q-jhj U m i n < 6 > )- ^ ^ djhj E ^ T" ^min- 

j€N+ j£N+ 

where a m i n =min a,-. To ensure that all minimal cover cuts are found, we actually solve 

j€N+ 

the cut-finding problem \N + \ times with each dj = a m i n , 3 € N + and requiring hj = 0 for 
every dj < a mm . (Actually, we need to solve the cut-finding problem only \N + \ — p times, 
where | A + 1 — p is the number of distinct dj, j E N + .) 

(3) Constraint (III.4d) sets the right-hand side r of the prospective cut: 

r = hj - 1 = \S\ - 1. 

j£ N+ 

(4) A violated MCVI has been found if 

53 *i h j ~ r * > o, 

j£N+ 

where h* and r* solve the cut-finding problem. 

3. Dynamic-Programming Reformulation 

We reformulate the cut-finding problem in order to solve it with dynamic program- 
ming. We can combine (III.4a) and (III.4d) by solving (III.4d) for r, and substituting for r 
in (III.4a). Also, (III. 4b) and (III.4c) can be combined into a two-sided constraint. Thus, 
the actual cut-finding problem we solve is: 



38 



maximize J2 (% — l)/ij 

j€N+ 

subject to: 6 + 1 < £ aj hj < 6 + a min (III.5) 

jeN+ 

hj € {0, 1} V j € A r+ , 

where the problem is solved |iV + | times with each a 3 = a min , j e N + and requiring 
hj = 0 for every a 3 < a min . A cut is found if the objective function value is greater than 
- 1 . Note that this formulation is similar to the constraint identification problem of Crowder 
et al. (1983) except that our requirement for integral data allows us some simplifications. 

The reformulation (III. 5) can be solved via this standard dynamic programming re- 
cursion: 

DP Recursion 1 

Initial conditions: 

d 0 (0) = 0 

d 0 (a') — -oo for a 1 = 1, ..., 6 + a min 
dfc(a') = — oo for all k, a' < 0 

Recursion: 

d k (a') = max {d fc _i(a , ) ) d k ~i(a' - a k ) + (x k - 1)} 
for k = 1, |A^ + | ; a' = 0, ..., 6 + a min . 

The solution to the problem is 



v 



* 



= max 

6-j- 1 ^ oJ ^ 6-j- Q.i 



d|jv+|(a'). 



If v* > —1, then an XVMCC has been found, and the corresponding mini- 
mal cover variables and the value of r* can be recovered through auxiliary data structures 
within the dynamic programming algorithm. 



B. LIFTING A MINIMAL COVER CUT TO A STRONG COVER CUT 

In order to obtain a violated facet of the knapsack polytope, we begin with an 
XVMCC, and apply two lifting processes and one of two tightening processes. This section 
describes the two lifting processes which create a strong cover cut from a minimal cover 
cut. 
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1 . 



Simple Lifting 



Simple lifting adds variables to the original minimal cover cut, possibly enabling 
more IP-infeasible fractional solutions to be eliminated from subsequent solutions of the 
LP relaxation of the MIR The resulting strengthened minimal cover cut is called a “lifted 
minimal cover cut” (LMCC). This lifting process can be performed on any MCVI, and is 
accomplished by forming the extension of the minimal cover S using the following proce- 
dure. The justification follows the procedure statement. (This procedure is very simple, but 
is stated formally for later reference.) 

PROCEDURE 1 (Simple lifting algorithm) : This algorithm takes the coefficients of the 
knapsack constraint with index set N, and the minimal cover S and returns the index set 
E(S), the extension of the minimal cover. 

Input: The index set of the cover S, and the vector of constraint coefficients dj, j € N . 
Output:!? (£), the extension of the minimal cover S. 

Begin 



S — {i (= N ^.Slaj > dj max } 

E(S) = SUS 
Return E(S) 

End 

Given E(S) from Procedure 1, the LMCC is 



jeB(S) 

Note that because S C E(S), and the right-hand side of the original MCC is the 
right-hand side of (III. 6), 



= max a,- 
jes 3 




(III.6) 



> l 5 l “ 



jeE(S) 



and (III. 6) is a cut. 

Justification for Procedure 1: 



For the MCC’s minimal cover S 



a > > 6> 
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and the MCC is 



a j < b, V jk € S, 

j€S—{jk} 

x > ^ l 5 l ~ L 

its 

If we add any x*, i € TV — S with a* > max a,-, there still can be no more than |5| — 1 

jes 11 

variables Xj that can be set to 1, and thus 

^ - 1 

j€E(S) 

is also a valid inequality. 

Example 1 (part a): Suppose the solution to the LP relaxation of a MIP with knapsack 
constraint 



4xj + 4X2 “I" 2x3 "b 2X4 "b 5X5 + 3X6 *b 9X7 + 3xg + 8x9 < 10 



is 



1 . 

= -,X 2 = l,x 3 = l,x 4 = l,Xj = 0 V J > 4. 

The knapsack constraint contains one fractional variable. The solution to (III. 5) yields the 
minimal cover S — {1, 2, 3, 4} and the MCC is 



X\ + X 2 + x 3 + x 4 < 3. 

Using input S = {1,2, 3, 4} and N — S = {5, 6, 7, 8, 9), Procedure 1 computes S = 
{5, 7, 9} and returns E(S) = S U S = { 1 , 2, 3, 4, 5, 7, 9} . The initial MCC has now been 
lifted to an LMCC: 

xi + x 2 + x 3 + x 4 + x 5 4 - x 7 + x 9 < 3. 

End of Example 1 (part a) 

2. Interior Lifting 

The linchpin of our facet-finding process is a procedure we call “interior lifting.” 
Interior lifting, unlike simple lifting, affects the composition of the base cover (the minimal 
cover S found by the XVMCC) because it lifts variables into the LMCC that have constraint 
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coefficients smaller than a Jmax = max aj. At the conclusion of interior lifting, the indices 

jes 

corresponding to the |S| smallest constraint coefficients in the revised LMCC form a strong 
cover S' for the constraint. 



Again, we review some of the key definitions. Recall that a strong cover S' is a 
minimal cover for which either 



or 



where 



E(S ' ) = N 



(HI*7) 



yi a s + °w ^ 

"{jmax} 



(HI-8) 



and 



3 max =arg max aj 

jes> 



^ 7 max 



= max a, 
i€W-£(S') 



Given N, coefficients aj, V j € A, a minimal cover 5, and E(S), the following in- 
terior lifting procedure creates a strong cover cut from a lifted minimal cover cut. 



PROCEDURE 2 (Interior lifting algorithm): This algorithm takes A, aj, V j e N, S, 
and E(S) and returns the extension of a strong cover E(S'). 

Input: N, aj, V j € N, S, and E(S). 

Output: E(S'), the extension of a strong cover S' 

Begin 
So = S. 

E(S 0 ) = E(S). 

So = E(So) - S 0 . 

2 = 0 

While ^ < |7V - E(S 0 )\ - 1 
Jmax =argmax a, 

]£Sg 

ai — max 



j€N-E(S g ) 



If a,- < b- 



E 



j€S 9 -{j max } 

Go to TERMINATE 



Else 
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■Sp-1-1 — Sg + {ip} {jrnax} 

Sg+1 = Sg + {jmax} 

9 = 9 + 1 
Endif 
Endwhile 

TERMINATE: Return E(S') = S g US g . 

End 

Ifanaj 9 ,z s € N-E(S) is found such that a, 9 < b- a j, condition (III. 8) 

j€Sg~{jmnx} 

is met. If all a ig >6- a j, 9 = 0,1, |iV - E^So)! - 1> then condition (III. 7) 

jSSg — {jinax} 

is met. In either case, the resulting cover is a strong cover, and the variables corresponding 
to a lifted strong cover valid inequality enable the formation of a strong cover cut 

E ^IS'l-1. (IH.9) 

jeE(s') 

where S' is a strong cover. Note that 

^2 x i - 1^1 ~ 1 

jes' 

is a strong cover valid inequality, but may not be a cut because some or all of the variables 
with positive LP solution values may have been removed from the original minimal cover 
S and placed in S' of the strong cover. However, because all such variables migrated from 
the original cover into S', S C E(S') — S' U S' and since the right-hand side of the valid 
inequality did not change, (III. 9) is also violated. 



Theorem 3.1 Let E{S ) be the extension of a minimal cover for (III . 1 ) corresponding to 
a minimal cover cut. If S is not strong , successive minimal covers can then be created 
using Procedure 2 that will result in the formation of the extension a strong cover E(S'). 
Furthermore, this extension will correspond to a strong cover cut. (Thus, we start and end 
with a violated valid inequality.) 



Proof. If So = S is not strong, there is some 



a *max < ^jmaxi *max £ F E(Sq) 
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such that 



where 



T. a J + a *max > b 
jes 0 -{j 

max} 



and 



jmax =arg max aj 
jtSo 



a %ax 

Recall that E(Sq) = So U Sq where 



= max a,i 
i€N-E(S 0 ) 



So = {i e N - So \ di > a,j > Vj G So} • 



Since 

a *max > b ~ a j? 

iGS 0 -{j 

max} 

a new minimal cover Si is created 



5 0 {j'max} "h {^max} • 



A new extension is created 



Si — Sq U {j'max} 



which is valid because 



G jmax — a il ^ ^ ‘S'l- 

Let S p be the pth minimal cover obtained by applying this procedure iteratively. If 



>b- aj 

j£Sg~{ Jmax} 



where 



and 



j max =arg max aj 

jeSg 



let 



= max on, 
ieN-E(s g ) 
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and 



Sg+1 Sg {jmax} 4* g } > 



*^9+1 Sg U {j max} • 

The procedure may terminate before examining all of the \N - E(Sq) | coefficients. 
Suppose at iteration k 

a i k < b — ^ ] a j ) 

max} 

where 



Then, 



a*. = max a*. 
i€N-E(S k ) 



^ aj + ai < b Vi e N — E(Sk), 

jes k -{j max} 



condition (III. 8 ) is met, and S' = Sk is therfore a strong cover. If all \N — E(Sq)\ = p co- 
efficients are lifted in, E(S P ) = N, condition (III. 7 ) is met, and S' = S p is a strong cover. 
Furthermore, since the index of any variable that leaves the initial minimal cover must be- 
long to the extension of the strong cover, the lifted strong cover valid inequality must be 
violated just as the minimal cover cut is, i.e., the resulting lifted strong cover valid inequal- 
ity is a strong cover cut for x. OED 



Example 1 (part b) Continuing with Example 1, we now must consider variables in N — 

E(S) (identified below) with coefficients less than a Jmax , where a Jmax = max a 3 . Let S = 

j€S 

So . We are considering the constraint 

4 xi + 4x2 + 2x3 + 2x4 + 5x5 + 3 X 6 + 9X7 + 3 x 8 + 8x9 < 10 



and the cut 



Xj I X2 I 2.3 I X4 I 2.5 I X7 I X9 3 , 
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where S 0 = {1,2,3,4},S 0 = {5,7,9 } , E(S 0 ) = S 0 U S 0 = {1, 2, 3, 4, 5, 7, 9), 
N - E(So ) = {6, 8} , and a Jmax = a x = 4. (Note: a Jmax = a 2 would also be correct.) Since 
aj+G 6 > 5, condition (III. 8 ) is not met, and So is not strong. Applying Procedure 

j€S— {jmax} 

2 , Si is now formed as 

Si = So — {1} + {6} 

and Si is formed as 

Si = So 4- {1} . 

Now we have Si = {2,3,4,6},S X = {1,5, 7,9} , E(S{) = S X US X = { 1 , 2, 3, 4, 5 , 6 , 7 , 9 } 
and N — E(Si) = {8} . Since 

'y ^ o.j + ag < b, 

j'eS-{j' m ax} 

Si is strong, so S' = Si . The strong cover cut is 

xi + X 2 + £3 + X 4 + x 5 + xe + x 7 + £9 < 3. (III. 10) 

Recall that the initial cut began with variables positive in the solution to the LP relaxation. 
They were 

1 

£l 2 ’ 1 : £3 1 ) £4 — 1 . 

Since all variables from the initial cut are in this lifted strong cover valid inequality and the 
right hand side of the cut has remained the same, (III. 10) is a cut. 

Note that since ae = a 8 , we can exchange x$ with x$ in (III. 10). This new valid 
inequality is still violated, and would lead to a different knapsack facet than the facet we 
find in the next section’s example. 

End Example 1 (part b) 

C. TIGHTENING A STRONG COVER CUT TO A FACET 

A strong cover cut that is not a facet can be tightened to a violated knapsack facet 
using techniques we develop here. We call the strongest of covers a “tight” cover. A strong 

cover is tight if a j — b = 1 . For strong cover cuts with tight covers, the facet coefficients 

j€S' 
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are w; = 1 for all i E S', and are determined by a simple rule based on the value of a* for 
all i E S' = E(S') - S'. However, for strong cover cuts that are not tight aj — b > 1 ), 



determining the facet coefficients u;, for i E S' requires a more complex procedure. The 
algorithm developed by Zemel (1989) allows us to compute the facet coefficients for a 
minimal cover, and we adapt it for use on strong covers that are not tight, allowing us to 
make some simplifications. The recursive procedure we develop can be viewed as a simple 
extension of interior lifting that examines the constraint coefficients a , of the variables with 
indices in S' and assigns to each variable the appropriate facet coefficient Thus, we 
have two tightening results based on the “tightness” of the strong cover, i.e., on the value 
of a j ~ b, that tighten strong cover cuts to violated facets of the knapsack polytope. 



1. Tightening Result I 

We would like to be able to directly assign the appropriate facet coefficients based 
on the value of aj, j E S'. However, this can only be done when the constraint coefficients 
aj meet certain conditions. We state, without proof, a theorem by Balas: 

Theorem 3.2 (Balas, 1975) Let S = {ji, j 2 , beaminimal cover for (111.1) ordered 

so that aj 1 < a j2 < ... < a j{sr LetE(S ) be the extension of S , and S h = {j\ S \-h+i, j\s\-h+2, -,j\s\}', 
i.e., Sh corresponds to the index set of the h largest coefficients in the ordering of S. Let N 
be partitioned into No,Ni,...,N q , q = |S| — 1, where 



j€S' 



jes' 



N 0 = TV - E(S), 

Ni = S U {i € E(S) — S\ai aj}, 



jes 2 




and define 



iTj = hV j E Nh, h = 0,1, .... q. 



Then, the inequality 




( 111 . 11 ) 



jeS j£N-S 

is satisfied by all x E P. Furthermore, if 




(III. 12) 



j€S—Si i+i 
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then (III. 11) is a facet of P. 



Remark. Condition (III. 12) implies that S is a strong cover. 

Note that Balas’ condition (III. 12) really imposes a much stronger condition than a 
strong cover. The only requirement for a strong cover is 



Y. a j + a imax < b 
j£S'—{j max } 



where 



and 



Jmax =arg max aj 

jes’ 



aj„„ = max a, 
i£N-E(S ') ' 



This is equivalent to di<b- X) a.,, V i € iVo, which is only one of the |S| conditions 

j€S— Si 

of (III. 12). 

Example 2: Given the knapsack constraint 



5xj + 5x2 4- 6x3 4- 6x4 4- 7x5 + 8x6 + 9x7 + 10xg < 11 

and a minimal cover S = {1, 2, 3}, it is obvious that E(S) = N, and the cover is strong. 
Balas’ theorem places the entire extension in iV) = (4, 5, 6, 7, 8} yet only the coefficient of 
X4 meets condition (III. 12). Thus, the valid inequality derived by the theorem, 



X\ + X2 + £3 + X4 + X5 + X6 + X7 + Xg < 2, 

is not a facet. The facet, which can be derived by Zemel’s algorithm, is 

X \ + X2 + X3 + X4 + 2x5 + 2x6 4 " 2x7 4 " 2xg < 2. 



End Example 2 

Because our goal is to derive facets, we state the following corollary to Balas’ the- 
orem, which shows that if S' is a tight cover (i.e., X a j ~ b = 1) Balas’ theorem is 

j es 7 

guaranteed to derive a facet. 

Corollary 3.3 If S' is a tight cover then the inequality' (III. 11) created by Balas’ theorem 
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is a facet. 



Proof. If 



then 



or 



^2 a j-b=l, 

jes’ 



Y a-)+ Y 

^s' h+1 



a j ~ b = 



1 



aj -i = b~ y 

jcK+i i£5'-s; +1 

Balas’ theorem assigns 7 r t = h. for all i such that 



CLj. 



(III. 13) 



Y a J ^ a i < a i’ V2 € h = 0, 1. (III. 14) 

izs'h j£S' h+ i 

Because of the integrality requirements for b and all aj, (III. 14) can be rewritten as 



Y a i - ai - ^2 a i ~ lj V * G Nh > h = 0,1, ..., q, 

jGS' h jzs’ h+l 

which, substituting for the right-hand side using (III. 13) yields 



Y, a i — a * - b - ^2 a i^ i € Nh, h = 0, 1, ...,q, 

ie5' ieS'-S' h+1 

which are the conditions specified in (III. 12). Thus, when aj — b = 1, the coefficients 

j£S' 

assigned by Balas’ theorem must meet conditions (III. 12), and the derived valid inequality 
(III. 11) defines a facet of P. OED 



Note that when the cover is tight, (III. 13) allows (III. 14) to be rewritten as 

b— } aj<ai<b— > aj, Vi 6 Nh, h = 0, 1, ..., q. 

We will use these intervals in the following procedure to assign facet coefficients, but we 

redefine a j as the partial sum .4(s — h), the sum of the s — h smallest aj, j e S' 

jes'-s' h 

where s = |5'| . 
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The following procedure applies Corollary 3.3. 



Given a tight strong cover S' , and the partial sums A(z ), z = 1 , ..., s , defined as the 
sum of the t smallest a,j, j € S', the following algorithm assigns facet coefficients for all 
variables Xj, j € N. 

PROCEDURE 3 (Tightening algorithm I): This algorithm takes a tight strong cover S' 
and the constraint coefficients in 5" = E(S') — S' and returns the facet coefficients w, V 

i e s’. 

Input: S' = E(S') - S' and S'. 

Output: u>i for all i € S'. 



Begin 

Order i € S' such that < a i2 < ... < ai| § ,|- 

Order i € S' such that a n < aj 2 < ... < aj| S ,|. 
A(0) = 0. 

Compute A(z), z = 1,2, ..., |S"| . 
s = |5'| . 



k = 1 
h = 1 



For k = 1,2, ..., 



5' 



If a ik < b - j4(s — (h + 1)) 



LUi = h 



Increment k 
Else 

Increment h 
Endif 
Endfor 
End 



5 ' 



The complexity of this algorithm is 0(|5'| log |5'|) + 0( 
), which is no worse than 0{n log n). 



S' 



log 



5 ' 



) + 0 (| 5 '| + 



Example 1 (part c) Finishing the problem begun in the first example, we first check 



Yj a-j - b. Since Y a j - b = l, Corollary 3.3 applies, and we assign u>i using Pro- 
jes 1 jeS' 

cedure 3. Recall that the constraint is 



4xj + 4x2 + 2x3 + 2x4 + 5x5 4- 3x6 + 9^7 + 3xs + 8xg 10, 
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the tight cover is S' = {2,3, 4, 6} , and the strong cover cut is 



Xi + X2 + x 3 + X 4 + X 5 + X6 + X? + Xg < 3, 

with E (S') = {1,2, 3, 4, 5, 6, 7, 9} . We first calculate the set of limits, and the sets defined 
on these limits to assign the appropriate coefficient Uj for variable xy. 

N h = {iE E(S') \b- A(s - h) < ai <b- A(s - (h + 1))} , h e {2, 3} . 

Any j € E(S') such that 6 < a.j < 8 has u>j = 2, so wg = 2 and any j 6 E(S') such that 
8 < a.j < 10 has Uj — 3, so cj 7 = 3. To determine members of E(S') that are assigned the 
facet coefficient Uj = 1, we use 

Ni = S' U {i € E(S') - S' \a t <b-A(s- 2)} . 

Variables Xj, j G {1,2, 3, 4, 5, 6} meet this criterion. The cut is now 



This valid inequality must be a facet of the polytope of the original knapsack constraint 
because it satisfies the condition in the corollary. Recall again that we began this tightening 
process with a valid inequality which was a strong cover cut. The variables positive in the 
solution to the LP relaxation were 



Since all variables from the strong cover cut are in this facet with facet coefficients Uj > 1, 
and the right hand side of the valid inequality is the same as that of the strong cover cut, 
this facet is also a cut because 



x\ + X2 H" x% + X4 + X5 + xq + 3 x 7 + 2x9 — 3 - 



1 „ 

= -,X 2 = l,x 3 = 1,X 4 = 1. 




jes' je §> 



End of Example 1 (part c) 
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2 . 



Tightening Result II 



If the strong cover is not tight, i.e., if 

53 aj - b > 1, 

we cannot assign facet coefficients using Corollary 3.3. The recursive procedure we de- 
velop next, which is similar to Zemel (1989) assigns the appropriate facet coefficients in 
polynomial time. Zemel developed his algorithm to solve Padberg’s series of problems that 
assign facet coefficients. First, we examine Padberg’s result. 



a. Padberg’s result 

A facet-finding result by Padberg (1975) has been the foundation for many 
of the critical discoveries of the knapsack polytope. This result, stated without proof, creates 
a facet of the knapsack polytope by sequentially lifting variables into an MCVI. 



Theorem 3.4 (Padberg 1975). Let S be a minimal cover for (III. 1), let N -S = {f i , ...,i p } 
be arbitrarily ordered and consider the sequence of knapsack problems 
K S [if] defined recursively as 



KS(i k ) z ik = maximize x 3 


l k-x 

i+ 2 Pi x i 






jes 


i = il 








h-i 






subject to: ff ajx . 


j+ a i X i 


< 


b di k 


j£S 










x j 


e 


{0,1} Vj€5 




Xi 


€ 


{0,1} Vi e N - S 



for k = 1 , ..., p (where summation over the empty set is 0), with the coefficients defined 
by 



/3j = |5| - 1 — Zi, i = *i, ..., i k - 1- 

Then, the inequality 

5 >; + 53 Pi x i <\ s \- 1 

jes ieN-s 



is a facet of P. 
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The theorem implies that a series of \N - S\ IPs (knapsack problems) must 
be solved to determine the coefficients (3 



b. Zemel’s result 



Zemel recognized that Padberg’s problem could be solved in a much simpler 
way. First, he recognized that Padberg’s procedure was related to the set of dual knapsack 
problems DKSi(z), z = 0, s — 1 where s = |Sj . 

l k - 1 

DKS ik (z ) A ik (z ) = minimize Y ajXj+ Y a i x i 

j€S 2=21 

l k-l 

subject to: Y x j+ Y 0i x i ^ 2 

jes 2=n 

Xj G {0, 1} V j € 5 
Xi e {o, i}\fieN-s 

The problem KS(i k) is related to the set of problems DKSi k (z), z = 0 , s — 1 via the re- 
lation z ik = max {z : A ik (z) <b - a ik } . 



ALGORITHM LIFT (Zemel, 1989): This algorithm assigns facet coefficients for all vari- 
ables Xj, j € iV in polynomial time. This algorithm takes a minimal cover S, the partial 
sums £ t ,t = 1, ...,s — 1, defined as follows: 

ii = a hi where ji =argmin a 3 

jes 

£2 = t\ where 32 =argmin Oj t 

4- 1 = 4-2 + a Js _ x , where ) s _x = argmin a, 

j€S-{jl}-...-{j s -2} 

the right-hand side b and the constraint coefficients in S = E(S) - S and returns the facet 
coefficients V i € S. 

Input: S — E(S) - S (in any sequence) for a minimal cover S, the right-hand side 6, a, V 
i € S, and the partial sums 4, t = 1, ...,s — 1. 

Output: Pi for all i € S. 

Begin 

Let Ai(0) — 0, Ai(z) — i z ,z = 1, ..., 5 — 1 
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For i = 1, 



5 



Zi = max { z : Ai(z ) < b — a*} 
Pi = S - 1 - Zi 



For 2 = 0, s — 1 



If 2 < A i+ x{z) = Ai(z) 

Else A i+1 (z) = min {Afz), Afz -/?,.) + a*} 

Endif 

Endfor 

Endfor 



End 



The facet that corresponds to this algorithm is 



x i + H Pi Xi - l 5 l “ L 

i^ s ies 

Note that the facet produced will depend on the order in which the elements of S are 
processed. 

In practice, we will apply a variant of Zemel’s algorithm after we have lifted 
to a strong cover cut and determined that the strong cover cut is not tight. Because we begin 
the process with a strong cover cut, the facet we find will be a violated facet. 



c. Tightening Algorithm II 



We will modify Zemel’s algorithm to efficiently tighten strong covers. First, 
by calculating (and updating) one additional sum, we may be able to terminate the algorithm 
after only assigning a few facet coefficients, leaving the others to be assigned by Procedure 
3, a much simpler procedure. The use of this additional sum will also allow us to avoid 
many of the checks min {Apz), Apz — P { ) + a i} made in Algorithm Lift. 

Let 5 = |5 ; | and define Aj(s) = a j- 

jes 1 



Corollary 3.5 If A i(s) — 6=1, then all remaining S' — i facet coefficients can be 
assigned using Procedure 3 with the current partial sums Afz), z = 0,1, ..., s. 



Proof. If Afs) — b = 1, we will show that 



Ai(z - PP + a,i> Ai(z), 2 = 0,1, ..., s. 
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Therefore, the assignment 



Ai+i(z) = min {Ai(z), A t (z - pp + aj 



becomes 



and 



Ai+\{z) = Ai(z), 



Ai+k^z') — Apz), k — 2 ,..., 

which allows coefficients 

@i+k-> k = 1, S 

to be assigned using the partial sums 



S' 



Ai(z), z = 0 , 1 , 



Suppose j4j(s) -6=1, but Ai(z - pp + a, < Ai(z) for some 2 = p { , 0 i + 1, 5 . We 
know that x x is assigned coefficient p t when 



j4,(s — 1 — ftp + a,i < b and i4*(s — PP 4- a,- > b. 



Since 



Ai(s - PP + a { > b. 



and 



,4i(s) — 1 = 6, 



then 



Pp 4" flj > Ai(s) 1, 

and, because of the integrality of the data, 



A;(s - PP 4- a, > j4*(s). 



Because of the way the partial sums were formed and updated, we know that 



Ai(s) - i4 t -(s - PP > i4,(s - k) - Ai(s - /?,• - k), k = 1, 2, s - /?,, 
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and since 



a i ^ Pi) i 



we know that 



a; > vli(5 - k) - ^(s - Pi - k), k = 1, 2, ...s - 

Equivalently 

Ai(s — Pi — k) + a t > >lj(s — k), k = 1, 2, ...s — f3 { 
which is a contradiction. There cannot exist Afz — j3 { ) + a, < Afz ) for any 2 = 1, s. 
So, 

^|s|( z ) = ^| 5 |-i( z ) = - = A i+1 (z) = Ai(z), z = 0, 1, s, 

and all unassigned facet coefficients can be assigned using Procedure 3 with the current set 
of partial sums Ai(z), z = 0, 1, s. 

QED 

Corollary 3.6 Ifoti > Ai(s) — Afs — P t ), all partial sums used in iteration i+1 will be the 
same as those used in iteration i of Algorithm Lift, that is, Ai+fz) = Afz), z = 0,1, s. 

Proof. If a, > Ai(s) - Afs - pp, we will show that 

Afz dp ~\~ Qi ^ Afz), z 0,1, s. 

Therefore, the assignment 



A i+ i{z) = min {Afz), Afz - pp + a,-} 



becomes 



Ai+i(z) = Ai(z), z = /3i + 1 , s . 

Suppose a* > j4j(s) - ^(s - pp, but Afz - PP + a { < Afz). Because of the way the 
partial sums were formed and updated, we know that 

Ai(s) - A t (s - PP > Ai(s - k) - Ai(s - Pi - k), k = 1,2 - P { 



and since 



Of — ^f^) Ai(s Pi)t 
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we know that 



a-i > Ai(s - k) - Ai(s - Pi - k), k = 1, 2, ...s - 



Equivalently 



Ai(s - /?j - k) + Oj > >li(s - A:), /c = 1 , 2, ...5 - /?, 



which is a contradiction. There cannot exist Ai(z — f3 { ) + < Ai(z ) for any 2 = 1. 5. 

So, 

A i+ i(z) = Ai(z), z = 0,1, s, 

and all partial sums used in iteration 1 + 1 will be the same as those used in iteration i. 
QED 

Corollary 3.7 If the Xi, i € S are assigned facet coefficients in ascending order of the 
constraint coefficients a*, i € S, the algorithm can be terminated when the first x, receives 
facet coefficient /?,• = [|J + 1, and the remaining x t , 1 £ S can be directly assigned facet 
coefficients using Procedure 3 with the current partial sums Afiz), z = 0. 1. s — 1 — f3 { . 

Proof. When = [|J + 1, 



The smallest partial sum that can be adjusted is 

Ai+i(0i) = min {Ai(0i), Ai(z - + a,} . 

Because of the imposed ordering, a;+i > a,. This means that b — a{ + 1 < b — a,, and thus, 
the largest partial sum smaller than the difference b - a l+x can be no larger than 



the remaining i € S will be assigned facet coefficients based only on the partial sums that 
will never be adjusted if the procedure were allowed to continue, that is 





Since 




i4|g|(z) — ^4 1 § 1 i(^0 — ••• — A{+i(z^ — Afzf'rfz < /3j. 
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QED 



Given the following corollaries, we modify Algorithm Lift to assign facet 
coefficients. We begin with a strong cover S' that is not tight, and define the partial sum £ t , 
t = 1 , ..., s, as the sum of the t smallest a,j, j € S' where s = |5'| . 



PROCEDURE 4 (Tightening algorithm II): This algorithm takes the constraint coeffi- 
cients in S' = E(S’) — S’ for the partial sums £ t , t = 1 , 5 for a strong cover S' and 
returns the cut coefficients Ui. 

Input: S' = E(S') — S' and the partial sums £ t , t = 1, s for a strong cover S'. 

Output: u, for all i € S'. 



Begin 

Let Ai(0) = 0, Ai(z) = £ z , z = 1 , s, and order S' in ascending order of aj, 



h = 2 

For i = 1, 2, 




While h < 



J£| 

2 



+ 1 



7= b — Ai(s — h) 

7 = 6 -A 1 (s-(h + 1)) 

If a,i < 7, then 

uii — h — 1 

Else 

If a t < 7, then 

Ui = h 

If a,i < Ai(s) - Ai(s - h ) then 
If z < h, A i+ \{z) = Ai(z). 

Else Ai + i(z) = min {Ai(z), Ai(z — h) + oj , z = h, h 4- 1, s. 
Endif 
i = i + 1 
If j4j(5) = 6+1 

Terminate algorithm and assign remaining 

coefficients using Procedure 3 with current partial 
sums Ai(z), z = 0, 1..., s. 

Endif 

Endif 

Else 

h = h + 1 
Endif 
Endif 
Endwhile 

Use Procedure 3 with current partial sums Ai(z), z = 0, 1 , s to assign 
remaining coefficients 
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Endfor _ 

Return w* for each i e S' 

End 

Once all u l have been assigned, the strong cover cut has been lifted to 

u>iXi — — 

J'e5' ieS' 

which is a violated facet of the knapsack polytope. 

We illustrate Procedure 4 with a simple example: 

Example 3: Given the knapsack constraint 

4xi + 5x2 + 5x3 + 6x 4 + 7x5 + 8x 6 + 8x7 + 12x 8 + 13x g < 16, 

and a strong cover is S' = {1, 2, 3, 4} , s = 4, the corresponding strong cover cut is 

Xi + X 2 + x 3 + x 4 + x 5 4- X6 + X7 + Xg + Xg < 3, 



and the initial partial sums are 



Ai(0) = 0, A] (l) = 4, A,( 2) = 9, Aj(3) = 14, ^(4) = 20. 



Because the smallest a, that can get a facet coefficient must be greater than b—Ai(s—2) 

Ul 5 = 1. 

Since 



b — Ai(s — 2) < <26 < b — Aj(s — 3), 



u>e = 2, and since 



0-6 < Ai(s) - Ai(s - 2) = 11, 

we must adjust the partial sums A 2 (z): 

For z < 2, 

A 2 (0) = Aj(0) = 0, A 2 (1) = A!(1) = 4 
For 2 = 2, 3, ..., s, A 2 (2) = min {Ai(z), ^1(2 — 2) -I- ag} • Thus, 



A 2 (2) = min {9, 0 + 8} = 8, 
A 2 (3) = min {14,4 + 8} = 12, 
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A 2 (4) = min {20, 9 + 8} = 17. 



Since A 2 (s) — A 2 {4) — 17 = b + 1, we can assign the remaining coefficients using 
Procedure 3 with the partial sums A 2 (z), z = 0,1, ..., s. The facet is 

+ x 2 + £3 + X 4 + £5 + 2x6 + X 7 + 2x§ + 3 x 9 < 3. 



End Example 3 

Next, we illustrate Procedure 4 with a more complex example: 
Example 4: Given the knapsack constraint 

40xi + 41x2 “I - 42x3 + 43 x 4 4" 44xs 4“ 75x6 + 115x7 + 140xg ^ 170, 

the strong cover is S" = {1,2 , 3, 4, 5), and the strong cover cut is 

Xi 4~ X 2 4“ x 2 4- X 4 4- X 5 4- X 6 4" £7 4" x$ < 4, 



and the initial partial sums are 

Ai(0) = 0, j4i(1) = 40, A x {2) = 81, Ai(3) = 123, Ai(4) = 166, 4i(5) = 210. 
The first variable we consider is X6, the variable with the smallest a, in S'. Because 

b — .4j(s — 2) < a6 < b — j4i(s — 3), 



0^6 — 2, and since 

a 6 < ^(5) - j4j(s - 2) = 87, 
we must adjust the partial sums A 2 (z ): 

For 2 < 2, 

^ 2 (0) = ^i(0) = 0, .42(1) = Ai(l) = 40. 
For 2 = 2, 3, ..., s, A 2 (z) = min {Ai(z), Ai(z — 2) + ae} . Thus, 



A 2 (2) = min {81, 0 4 - 75} = 75 
A 2 (3) = min {123, 40 + 75} = 115 
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A 2 ( 4) = min {166, 81 + 75} = 156 
.42(5) = min {210, 123 + 75} = 198. 

Since A 2 (s ) = A 2 (b) = 198 > 6 + 1, we cannot revert to Procedure 3. 
We consider x 7 . Because 



b — A 2 (s — 3) < 07 < b — A 2 (s — 4), 

u> 7 = 3. We can revert to Procedure 3 according to Corollary 3.7 because w 7 = 3 = [ 
Instead, we will continue the process to verify the correctness of Corollary 3.7. 
Since 

a 7 < j4 2 (s) - A 2 (s - 3) = 123, 

we adjust the partial sums again. 

For z < 3, 



>13(0 ) = j4 2 (0) = 0, A 3 (l) = A 2 (l) = 40, A 3 ( 2) = A 2 (2) = 75. 



For 2 = 3, ..., 5, ^3(2) = min {A 2 (z), A 2 (z — 3) + <27} . Thus, 



A 3 {3) = min{115,0+ 115} = 115 
^3(4) = min {156, 40+ 115} = 155 
+13(5) = min { 198, 75 + 115} = 190. 



Since 

A 3 (s) = A 3 (5) = 190 > 6 + 1 
we cannot revert to Procedure 3 (via Corollary 3.5). 

We consider x 8 . Because 



b - ^3(5 -4 ) < a 8 < b - A 3 (s - 5), 
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tO|o> 



u 8 = 4 . Note that the only partial sums we use are 



A 3 (s - 4) = A 3 (l) = A 2 (l) 



and 

A 3 (s - 5 ) = A 3 ( 0 ) = A 2 ( 0 ). 

In fact, if we change the coefficient a 8 and let it be the smallest possible value given the 
value of a 7 and the imposed ordering, a 8 = 115 , we can see that in the worst case, 

b - A 3 (s - 3) < a 8 < b - A z (s - 4), 

and the only partial sums that would be used are ^3(2) = ^2(2) and ^3(1) = ^2(1)- Thus, 
the last adjustment was unnecessary, and we could have assigned u> 8 = 4 based on the 
partial sums A^z), 2 = 0 , 1 . The facet is 

+ x -2 + £3 + x 4 + x 5 + 2x6 + 3 x 7 + 4x 8 < 4. 



End Example 4 

D. NON-MINIMAL COVER CUTS FROM THE KNAPSACK POLYTOPE 

Although a knapsack constraint may contain one or more variables with LP solution 
values Xj that are fractional, there is no guarantee that an MCC exists. In the event no 
minimal cover cut exists for a candidate knapsack constraint, we develop a method that finds 
a “non-minimal cover cut” (NMCC), if such a cut exists. We distinguish between two types 
of NMCCs. A Type I NMCC only requires cut coefficients of 1 for variables in the NMCC, 
and, if the NMCC is not a violated “extended minimal cover valid inequality” (TMCVI), it 
is lifted by “deficit lifting” (and possibly simple lifting) to a violated TMCVI that is, in turn, 
lifted and tightened to a knapsack facet. Type II NMCCs are valid inequalities that require 
that one or more cut coefficients be greater than 1 to obtain a violated valid inequality. 

1. Non-Minimal Cover Cut-Finding Problem 

Once a candidate knapsack constraint is identified, the minimal cover cut-finding 
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algorithm is invoked. In the event that the algorithm finds no minimal cover cut, the NMCC- 
finding algorithm is called. We define a two-step procedure that first calculates the right- 
hand side of a “non-minimal cover valid inequality” (NMCVI), and then checks to see if the 
NMCVI is violated before any lifting or tightening is carried out. Given x, the right-hand 
side u)q is found by solving the following IP (which uses previously defined notation): 

Formulation: 



u> 0 = maximize 



E x j 

jeN+ 

subject to a j x j ^ 6 (III. 15) 

jeN+ 

Xj e {0, 1} V ji € N + . 

The standard dynamic programming recursion used to solve (III. 15) is: 

DP Recursion 2 

Initial conditions: 

d 0 { 0) = 0, d 0 {£) = -oo for all £ ^ 0. 

Recursion: 

d k (£) = max {d k - i(£), <4-i(f - a k ) + 1} for k = 1, ..., \N + \ and £ = 0, ..., b. 

The solution to the problem is u>q =max d\ N +\(£), and the NMCVI is 

(HI. 16) 

The second step of the cut-finding process is simply to check the NMCVI for violation. The 
NMCVI (III. 16) is a Type I NMCC if 



Y, *3 






> 0 . 



(III. 17) 



]£N+ 



An outline of the two-step NMCC-finding procedure follows. 



PROCEDURE 5 (Non-minimal cover cut-finding algorithm): This algorithm takes b, 

the values of Xj and a,j, j e N + , and returns u>o and the message that x 3 < uq is a 

je n+ 

Type I NMCC, or returns the message that no Type I NMCC exists. 

Input: The values of Xj and aj, j £ N + and the right-hand side of the constraint b. 

Output: The message that Xj < cao is a Type I NMCC and u o, or the 

je 
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message that no Type I NMCC exists. 



Begin 

Find uq by DP recursion 2 

If Xj — u>o > 0 

je N+ 

Return “NMCVI is a Type I NMCC” and w 0 
Else 

Return “NMCVI is not a Type I NMCC” 

Endif 

End 

Example 2 (part a): Suppose the solution to the LP relaxation of a MIP with knapsack 
constraint 

2x 1 4~ 4x2 + 8x3 4- 8x4 4- 8x5 < 10 (III. 18) 

is 

Xi = 1, x 2 = 1/4, x 3 = 1/4, x 4 = 1/4, x 5 = 3/8 
The knapsack constraint has four fractional variables, so it is eligible to have a cut derived 
from it. Note that any two of the coefficients aj, j € {2, 3, 4, 5} will form a minimal cover, 
so there are (2) MCVIs of two variables with the right-hand side of |S| — 1 = 1 associated 
with (III. 18). But, because no sum of any two Xj, j € {2, 3, 4, 5} exceeds 1, no minimal 
cover cut exists. 

The first step to deriving a possible NMCC is to find the right hand side of the 
NMCVI by solving (III. 15) with DP recursion 2. The solution is = 2, and the valid 
inequality is 

xi + x 2 + x 3 + X4 + X5 < 2. (III. 19) 

Checking condition (III. 1 7) confirms that (III. 1 9) is a Type I NMCC since 

Xi 4- x 2 + x 3 + X4 4- X5 > 2. 



End of Example 2 (part a) 

2. Deficit Lifting 

We find a facet from the Type I NMCC as we did from the MCC. If the wo 4- 1 
smallest aj, j € N + form a minimal cover, we designate the indices associated with the 
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wo 4- 1 smallest aj, j € N + as S and employ Procedures 1-4 as necessary to find a violated 
knapsack facet. If not, we must utilize a process called “deficit lifting” to find a TMCVI. 

Deficit lifting finds a violated valid inequality that can be lifted to a facet by exclud- 
ing variables from the Type I NMCC. To begin, we designate the variables with the wo + 1 
smallest a,-, j 6 N + as members of the (possibly non-minimal) cover S^ r . 

PROCEDURE 6 (Deficit lifting algorithm): This algorithm takes S^ r , the vector of con- 
straint coefficients aj, j € 5^ r , the right-hand side of the constraint b, the right-hand side 
of the NMCVI wo, and returns a minimal cover S^ r and u>m, the right-hand side of the 
NMCVI corresponding to S^ r . 

Input: dj, j € S°^, w 0 and b. 

Output: A minimal cover S^ T for the constraint. 

Begin 
9 = 0 

For g = 0, 1, ..., |w 0 | 

a, = min a 9 
9 jes? vr 3 

If £ a j < b 

j€Sc V r~ 

go to TERMINATE. 

Else 

Scvr 1 = $cvr ~ 
u g + 1 = u g ~ 1 
9 = 9 + 1 
End if 
Endfor 

Set S^ r — S^ VT and u m — g 

TERMINATE: Return and w M 
End 



The resulting valid inequality is 



Xj+ Xj < wo- 

]£S% r j€N+-S° vr 



(III.20) 



Of course, it would be pointless to lift a Type I NMCC with deficit lifting if the 
resulting valid inequality were not violated. Fortunately, the following result proves that a 
violated valid inequality always results from deficit lifting a Type I NMCC. 
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Lemma 3.8 A valid inequality created from a Type I NMCC by deficit lifting will always 
be violated. 



Proof. If 



then 



because 



53 x * + 53 x * > w o, 

jes° vr jeN +- S o vr 

53 %+ 53 ^7 > — i, 

jes°, r -{i 0 } j£N+-s° vr 



Xi Q ^ 1 . 

The result for Sf. r follows by induction on M. QED 

Note that (III.20) is not necessarily a TMCVI at this point. The actual TMCVI is 



53 53 x j — u> °' 

jes^ r jeE(SM r )-S% r 

However, since all a l > a jmax , i € N + — 5^ r where a Jmax = max a jy then A/" 1- — 5^, r C 

jeS™,. 

E(S^ r ) - Sjf r , and it is a simple task to use simple lifting (Procedure 1 ) to lift any remaining 
variables that belong in the TMCVI. After a TMCVI is completely formed, interior lifting 
(Procedure 2) and tightening (Procedure 3 or Procedure 4) will create a facet, just as they 
did with a lifted minimal cover cut. 

We continue with example 2 to demonstrate deficit lifting: 

Example 2 (part b): We have the knapsack constraint 



2xj -T 4x2 8x3 -(- 8x4 + 8x5 ^ 10, 

with LP solution values 



(III.21) 



xj = 1, x 2 = 1/4, x 3 = 1/4, X4 = 1/4, x 5 = 3/8, 

and the NMCC 

xi + x 2 + x 3 + X4 + X5 < 2. 

Since wq = 2, we form = {1, 2, 3} . Since a x — a io — min a^, the first iteration of 
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Procedure 5 finds that 



'Y/ a j ^ 

je5°, r -{io} 

so we form 5^ r = S£, r - {t 0 } = {2, 3} and wi = w 0 - 1 = 1. Since o 2 = 
the next iteration of Procedure 5 finds that 



= min a-j, 
j£Si vr 



Y a j < 

jes| vr -{ii} 

so Sl vr is a minimal cover, and 



Y x i + Y 

its*,,. jzN+-s° vr 



is a cut. The new cut is 



x 2 + X3 + x 4 4- x 5 < 1. (III.22) 

Since no lifting can be performed on (III. 22) and tightening assigns cut coefficients of 1 for 
all variables not in the cover, (III.22) is a facet of the knapsack polytope associated with 
(III. 21). 

End of Example 2 (part b) 



3. Type II Non-Minimal Cover Cut-Finding Problem 

Type II NMCCs are valid inequalities that require that one or more cut coefficients 
be greater than 1 to obtain a violated valid inequality. Type II NMCCs can be found by 
a three-step process. First, we solve the NMCC-finding problem. If the solution to the 
NMCC-finding problem indicates that no Type I NMCC exists, the NMCVI is lifted and 
tightened to a facet of the associated knapsack polytope much as we did for Type I NMCCs. 
We then examine the resulting facet-defining valid inequality. If the facet is violated, then 
we have found a Type II NMCC. If not, we must first check the strong cover S' used to 

find the facet. If a j — b = 1, then we know that we have assigned the maximum cut 

jes' 

coefficient to each variable in the cut, and no Type II NMCC exists. If a j ~ b > 1 , there 

jes' 

may exist other facets that can be found by exchanging facet coefficients among variables 
in certain equivalence classes. The equivalence classes are defined by 
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(III. 23) 



b - Ai(s - h) <di<b- A| §/ |(s - h), h = 2,3,..., \S'\ - 1. 

where A|^,| (s — h), h = 2, 3, ..., |S'| — 1 represent the last partial sums used by Procedure 4 
to fmd the first facet. The equivalence classes identify sets of variables that will have facet 
coefficients of either w* = h — 1 or w* — h. Note that in Procedure 4, the first coefficient that 
falls in any equivalence class will have a facet coefficient of w, = h and cause partial sums 
to be adjusted. If two variables are in the same equivalence class and have different facet 
coefficients, then the facet coefficients can be exchanged so the variable with the greater x { 
has the greater c 

The following procedure finds a Type II NMCC, if one exists. 



PROCEDURE 7 (Type II Non-minimal cover cut-finding algorithm): This algorithm 
takes b, the values of Xj and a 3 , j € N + , and w 0 , and returns the facet coefficients w- for 
Xi, i e S', or returns the message that no Type II NMCC exists. 

Input: The values of Xj and a.j, j € N + , the right-hand side of the constraint b, and the 
right-hand side of the cut u>q . 

Output: The facet coefficients u>\ for x i7 i e S', or the message that no Type I NMCC 
exists. 

Begin 

Lift the NMCVI to a facet by using Procedures 1 -6 as required. 

If £7+ Z) - w 0 > 0 

i€S' _ 

Return “Facet is a Type II NMCC,” and set u> • = w, for i € S'. 

Else 

If E a 3~ b = 1 

jes' 

Return “No Type II NMCC exists” 

Else 

For each equivalence class Q = 2,3,...,|5’ / | — 1 
For all i,k G. Q 

If u>i > u>k and x, < x k , i,k e Q 
ui' k = u>i and u)\ — u> k 
Else 

(jj\ = u>i for alii € Q 
Endif 
Endfor 
Endfor 
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If Z *i+ I] - u; 0 > 0 

jeS' ies 1 
Return w ' for i,, i 6 5' 

Else 

Return “No Type II NMCC exists” 
Endif 
Endif 

End 



Example 3: We have the knapsack constraint 

2xi + 2x2 + 2x 3 + 2x 4 + 3x 5 + 3x 6 + 3x 7 + 5x 3 < 6 (III. 24) 

with positive LP solution values 



x\ = 1/4, X 2 = 1/2, 13 = 1/2, x 4 = 1, x 7 = 1/2 



and the NMCVI 



x\ + X2 "I - 2:3 4 * x 4 + x 7 < 3 . 



(III. 25) 



Since 



xi + X 2 + x 3 + x 4 + x 7 = 2-, 

4 



(III. 25) is not a cut. If we form a TMCVI and lift and tighten it to a facet, we obtain the 
following valid inequality: 



x\ + X 2 + 2:3 + x 4 + 2 x 5 "I - ^6 "f X 7 + 3x§ < 3 

but still 

xj 4- X 2 + x 3 + X 4 + 2 x 5 4” xg + X 7 4- 3x8 < 3 

because the only variables that got larger coefficients were 0 in the LP solution. We define 
the equivalence classes using (III. 23): 

Equivalence Class 2 < a* < 4 4 < a* < 4 

Facet coefficients w* = 1 or 2 w* = 2 or 3. 

Since variables x 5 , xg, and x 7 are all in the same equivalence class (note the second equiv- 
alence class is empty), we find that w 5 > w 7 and X5 < x 7 , and we interchange w 5 and w 7 
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so that = 1 and u/ 7 = 2. The new facet is 



x\ + X 2 + X 3 + X 4 + X 5 4- xq + 2 x 7 ■+■ 3x8 < 3, 

and since 

x\ 4- X 2 4- X 3 4- X 4 + X 5 + xg + 2 x 7 4- 3x8 = 3— > 3, 

4 

it is a Type II NMCC. 

End of Example 3 

The procedure to form Type II NMCCs requires that we have a minimal cover from 
which we generate a facet. However, sequential lifting of facets associated with m inim al 
covers does not, in general, produce all facets associated with the polytope P (Balas and 
Zemel, 1 984). For facets not associated with minimal covers, a procedure similar to our 
XVMCC cut-finding procedure may be able to produce these facets. This procedure is left 
for future research. 



E. SUMMARY 

In this chapter, we developed new techniques for finding and lifting cuts from in- 
dividual knapsack constraints. We described an algorithm that finds a maximally violated 
minimal cover cut for a knapsack constraint if such a cut exists, an algorithm that lifts a 
minimal cover cut to a lifted minimal cover cut and we developed a new lifting procedure 
called “interior lifting” that lifts a lifted minimal cover cut to a strong cover cut. We adapted 
polynomial-time facet finding algorithms to tighten strong cover cuts to violated facets, and 
identified conditions and created procedures that streamline the facet-finding process. 

We identified a new type of knapsack cut, the “non-minimal cover cut,” a cut that 
cannot be found by solving the traditional minimal cover separation problem. We devel- 
oped non-minimal cover cut-finding procedures and a new lifting procedure called “deficit 
lifting” that creates a violated extended minimal cover valid inequality from a non-minimal 
cover cut, if necessary. The complete procedure of cut-finding, lifting and tightening for ei- 
ther a minimal or a non-minimal cover cut produces a violated facet in pseudo-polynomial 
time. 
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IV KNAPSACK CUT EXTENSIONS 



This chapter develops two extensions to the results of Chapter III on knapsack cuts. 
In particular, we show how to generate cuts for “elastic knapsack constraints” (knapsack 
constraints with penalized violation allowed), and for knapsack constraints with senses of 
“greater-than-or-equal-to” and “equality.” 

A. CUTS FOR ELASTIC KNAPSACK CONSTRAINTS 

Our research extends the basic results on the knapsack polytope to include the gen- 
eration of cuts from elastic knapsack constraints. The elastic knapsack constraint is 



where the aj and b are positive integers, aj < 6 V j E N, Xj are binary; and 0 < z < z: if 
z is not explicitly bounded above, then implicitly z = a j ~ The variable z represents 



the additional units of resource that can be used above and beyond the basic limit of b if an 
appropriate (linear) penalty is paid. We develop a method to cut off fractional solutions to 
elastic knapsack constraints that parallels many of the knapsack cut procedures developed in 
Chapter III. Because all cuts must be valid inequalities, we first examine valid inequalities 
for the elastic knapsack constraint. 

1. Valid Inequalities for the Elastic Knapsack Polytope 

We again focus on minimal covers, because we can extend many of our minimal 
cover cut results for standard knapsack constraints to elastic knapsack constraints. When 
we generate “elastic minimal cover valid inequalities” (EMCVI) for (IV 1), we note that if 
z is not explicitly bounded above, the implicit upper bound of z = ^ a j ~ b allows any 



integer solution to be selected for the right price. Thus, when z is implicit, z must appear 
in every EMCVI. 




(IV1) 



jeN 



jeN 



jeN 
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The conditions for the minimal cover are altered from the standard MCVI by the 
addition of the variable 2. S given 2, denoted will be an “elastic minimal cover” for 
(IVl)if 

Y, a j >b+ 

and 

^ a j < b + [z\ , Vi € Sz- 

Thus, an EMCVI for (IV1) is 






j£S 



T, a j~ b 

j£S 



<|S|-1. 



Example 1 (part a) Consider the elastic knapsack constraint 



2xi + 3 x 2 + 4 x 3 T - 6 x 4 + 3 x 5 + xg — z < 7 (IV2) 

where 2 = 3. Given an LP solution with z = 2, an elastic minimal cover is 5? = {1, 2, 3, 6} . 
The associated EMCVI is 

X! + X2 + X3 + X6 — ^ < 3. (IV3) 

o 

By rearranging (IV3), it becomes clear that, when 2 = 2 = 3 , 



is really enforcing 

xi + X 2 + x 3 + x 6 < 4, 

allowing all the variables in the valid inequality to be 1 . When 2 = 3, the rearranged elastic 
constraint (IV2) 

2 xj + 3x2 *{■ 4 x 3 + 6x4 + 3x5 + X6 ^7 + 2 



is actually enforcing 



2xi + 3x2 4- 4x3 + 6x4 + 3x5 + X6 < 10 

which does allow xi = X 2 = x 3 = X6 = 1. This verifies that the EMCVI we developed is 
a “valid” inequality, as it does not disallow any valid solutions given 0 < 2 < 2. 



72 



End example 1 (part a) 



2. Finding a Maximally Violated Elastic Minimal Cover Cut 

We now develop a procedure to find an elastic minimal cover cut (EMCC). A “max- 
imally violated elastic minimal cover cut” (XVEMCC) for an elastic knapsack cut may be 
found by modifying the XVMCC-finding procedure found in Chapter III. Specifically, the 
objective function and constraints must be modified to account for the constraint violation 
variable 2 . 



a. Cut-finding problem formulation 

In order to find an XVEMCC, we must identify a knapsack constraint of the 
MIP that has at least one variable with a fractional LP solution value x 3 . Once a suitable 
constraint is found, we solve the cut-finding problem: 

Indices: 

j e N = {1, 2, 3, n} variable index for the knapsack constraint 
N + ={j'GA|ij>0} where x is the solution of the LP relaxation of the MIP 

Given data: 



ij value for Xj in a solution of the LP relaxation of the MIP 
2 value for 2 in a solution of the LP relaxation of the MIP 
a-j knapsack constraint coefficient of Xj 
b right-hand side of the knapsack constraint 



Decision variables: 



h.j 1 if Xj is placed in the minimal cover inequality; 0 otherwise 
r is a general integer variable that is the right-hand side of the XVMCC 



Formulation: 
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z* el = maximize Y %jhj 

jeN+ 

subject to: Y a jhj 

j£N+ 

Y, a j hj 
je n+ 

Y o-jhj 

jeN+ 

E hi 

je n+ 

h j 



> b + \ z\ + 1 
— b \_z J + a m in 



€ 

t € 

r € 



0 

1 

{0,1} V j 6 N + 

{6 + [ z\ + 1, b + [7\ + a min } 

{0, 1, 2, \N + \ — 1} 

(IV4) 



where a min = min a,-. 

je N+ 

To ensure that all EMCCs are found, we actually solve the cut-finding problem |iV + | times 
with each aj = a min , j G N + and requiring hj = 0 for every aj < a min . (Actually, we 
need to solve the cut-finding problem only |iV + | — p times, where | A + 1 — p is the number 
of unique aj, j 6 N + .) 

Although the above IP is nonlinear, it can be solved fairly easily, and an 
EMCC has been found if 



where h *,t*,r* solve (IV4). 



jzs? 




> 0 , 



b. Dynamic-programming reformulation 



We reformulate the cut-finding problem in order to solve it with dynamic 
programming as we did in Chapter III. Thus, the actual cut-finding problem we solve is: 

xxxxx 



c el 



1 + 



max max 

t h 

subject to: 



Y “ l ) h j 

jeN+ 

b' < a jhj 

jeN+ 

S a j hj 

j£N+ 

by j 



z 

t-b 

< b " 

—t = 0 

6 {0, 1} V j 6 N+ 

t € {6',. ..,6"}, 



(IV5) 
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where b' = b + \ z\ + 1 and b" — b + [z\ + a min . The problem is solved at most |7V + | times 
with each unique aj = a min , j e N + and requiring every < a min , j e N + to have 

hj = 0 . 



The reformulation (IV 5 ) can be solved via a DP recursion 

DP Recursion 3 

Initial conditions: 

d o (0) = 1 

d 0 (a ) — oo for a lj . b Umin 
dk(a') = — oo for all k, a' < 0 

Recursion: 

•dk(a') =max {d fc _i(o'), d k -i{a' - a k ) + ( x k - 1)} 
h 

for k = 1, \N + \ , a' = 0 , b + a min . 

The solution to the problem is 

z 

z* t = 1+ max di^+da') — 

e b'<a'<b" 1 1 a' - b 



If z* el > 0 , where h* solves (IV 5 ), an XVEMCC has been found, and the corresponding 
elastic minimal cover S5 = {k\h* k = 1} can be recovered through auxiliary data structures 
within the dynamic programming algorithm. The XVEMCC is 



jes? 




< |Ss| - 1. 



Example 1 (part b) Suppose the solution to the LP relaxation of a MIP with knapsack 
constraint 



2xi + 3x2 + 4x3 + 6 x 4 + 3 x 5 + X 6 — 2 < 7 



is 

3 

Xl — 1, X 2 1, X 3 Tj X 4 0, X 5 0, X 5 1) Z w. 

4 

Recall the modification to the cut-finding problem changes the constraint, replacing the 
original 6 with b + \_z\ : 



2xi + 3x2 -I- 4x3 + 6 x 4 + 3x 5 + X 6 < 9. 



75 



The cut-finding problem looks for the most violated minimal cover cut, with 



violation =V x,- — — 1 S- 

k ,5 a > - b 



- ISsI - 1. 






We solve (IV 5 ) and find the EMCC 



Xy + X 2 + #3 + X$ — — < 3 

O 



which is violated, since 



violation = 



jes t 



E a j ~ b 

„3 2 o 

3- - - - 3 
4 3 

J_ 

12 



~ (| 5 ? | - 1 ) 



End example 1 (part b) 



3. Lifting and Tightening Elastic Minimal Cover Cuts 

Simple lifting can be conducted just as with standard knapsack cuts, but interior 
lifting and tightening must be altered in order to ensure that the cuts remain violated and 
valid. 



a. Simple lifting 

Any variable with a constraint coefficient greater than or equal to the largest 
constraint coefficient of the variables in the minimal cover S can be lifted. 

Example 1 (part c) Recall the EMCC from part b: 

z 

Xy + X 2 + X 3 + X & - - < 3. 

Because a 4 > <23 =max aj, the variable x 4 is lifted, creating the lifted EMCC 

2 

Xy + X 2 + X 3 + X 4 + Xq - - <3. 

o 
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End example 1 (part c) 



b. Interior lifting 



As with standard knapsack valid inequalities, it is theoretically possible to 
lift an EMCC to an elastic strong cover cut. However, once interior lifting is completed, the 
coefficient of the variable 2 in the EMCC must be recomputed using the coefficients of the 

variables in the strong cover S~. Since the cover is now strong, a j a j> and the 

jes'~ jes s 

coefficient of 2 , ^ ^ _ fc , is now larger. Because the 2 term is subtracted when calculating 

iesL 3 

the amount of violation, 



violation = V^ x 7 - — =r~ , 



the adjustment of the coefficient can cause the EMCC to “lose” its violation. Therefore, in 
practice, we do not use interior lifting on EMCCs that have 2 > 0. 

Example 2 (part a) Suppose the solution to the LP relaxation of a MIP with elastic knapsack 
constraint 



20xj + 25x2 4- 25x3 + 45 x 4 + 21xs — 2 < 50 
is 

5 . _ 8 

i\ 1 : X2 T X 3 ~ , X4 0, X5 0,2 8 ~ . 

The knapsack constraint contains two fractional variables. The solution to (IV5) is the 
EMCC with S 2 = {1,2,3} : 



2 

xj +X2 + X3 - — < 2 

which is a cut because 

^ ^ ^ 2 

X! + x 2 + X 3 - — > 2. 

Simple lifting extends the EMCC to 



2 

*1 + %2 + + *4 - 2 ^ < 2 , 

which is still violated since x 4 = 0. Next, interior lifting allows us to include the last 



77 



variable and create an elastic strong cover valid inequality. However, we must recompute 
the coefficient of z. When we do that, the valid inequality 

z 

Xi + X 2 + X 3 + X 4 + X 5 — — < 2 

16 

is not a cut because 

^ ^ ^ ^ z 

Xi + x 2 + x 3 + X 4 + x 5 - — = 2. 

16 

End example 2 (part a) 



c. Facets of the elastic knapsack polytope 

Once we have found an EMCC, we would like to form a facet of the elas- 
tic knapsack polytope. The variable z complicates matters, as we have already experienced 
with interior lifting. Since we cannot blindly apply the results from Chapter III, we must 
carefully identify under which conditions we can create a facet of the elastic knapsack poly- 
tope. 

When the elastic minimal cover £2 is strong, and z = Yh a j ~b, we can lift 

j£N 

the elastic strong cover cut to a facet of the elastic knapsack polytope. The conditions that 
identify if a cover Sj is strong are 

E(Si) = N, (IV6) 

or, if there are no variables that could be lifted (with a coefficient of 1) through interior 
lifting, that is, if 

'y ^ dj + aj < b + |zj , Vi € N — E(Sz), (IV7) 

— {j max} 

where j max =arg max a r If either condition (IV6) or condition (IV7) is met, then we 

jes? 

redesignate S~ as the elastic strong cover and 

Xj+ x i - £ aj-b - ^ " 1 

jes'; } eE(S'-)-SL J 

is a facet of the elastic knapsack polytope. 

Theorem 4.1 If the elastic minimal cover S'~ is strong, then the elastic strong cover valid 
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inequality 




(IV8) 



where z = a 2 - b and aj < 6 V j € N, is a facet of the elastic knapsack poly tope 



P E = conv < x G {0, l} n , 0 < 2 < 2 ajXj - z < b l . (IV9) 

l j€N J 

Proof. The valid inequality (IV8) is a facet of the elastic knapsack polytope if it is satisfied 
by every x e P E , and satisfied at equality by exactly d affinely independent points x 6 P E , 
where d — n + 1 is the dimension of P E . Consider the elastic constraint 
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0 
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0 


0 •• 


0 


1 



(where |Sj| = 2) is a facet of the elastic knapsack polytope for the strong cover S~ when E(S~) = N . So = + a 2 — 6 

and £* = ai + a 2 + a* - fc, /c = 3,4, 



In Table 1 there are n linearly independent points that satisfy (IV 1 1 ) at equal- 



ity, and since linear independence implies affine independence, the dimension of (IV11) is 
at least n. Since the dimension of the elastic polytope P E is n + 1 , (IV1 1) is a facet of P E . 




(IV 10) 





(IV11) 



where z a,j — b. 

jeN 



Table 1. This table contains the n linearly independent points that demonstrate the elastic strong cover valid inequality 
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The result for |S~| = k, k > 2 follows by induction on k. 

Note: We can easily form | N - £(S~)| other linearly independent points for 
the case E(S~) < N to verify that the facet has appropriate dimension when variables are 
implicitly assigned a facet coefficient of 0 by their exclusion from the inequality. QED 



When we have an EMCC and z > 0, we must forego interior lifting. Thus, 
if Sz is not strong, we will not create a strong cover from the elastic minimal cover, and the 
(possibly lifted) EMCC may not be a facet. This next example shows why this is true. 
Example 3 Suppose the solution to the LP relaxation of a MIP with elastic knapsack con- 
straint (with z not explicitly bounded) 

20xi + 25x2 + 21x 3 — z < 40 



is 



- i * 21 - , 

Xi = 1, x 2 = — , 2:3 = 0,Z = 1. 

25 

The knapsack constraint contains one fractional variable. The solution to (IV.5) is the EMCC 
with Sz = {1,2} : 



which is a cut because 



X\ + X 2 — ~ S 1 

5 



Xi +X2 — - > 1- 
5 



(IV 12) 



When we include X 3 by interior lifting, 



Xl +X 2 + X 3 -j <■ 1 



is not a cut because 



^ ^ ^ z 

X 1 +X 2 + X3--<1- 



So, we must use (IV 12) as a cut. But, is it a facet of the elastic polytope? Recall that a 
facet of the integer polytope Pe (IV9) is an inequality that is satisfied by every x € Pe, 
and satisfied at equality by exactly d affinely independent points x € Pe, where d is the 
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dimension of P E . We examine the points that satisfy (IV12) at equality in this table: 





X 


^ p e 


X 


£p e 


x x 
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0 


1 


1 


0 


1 


x 2 
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1 
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1 


1 


z 


0 


0 


5 


0 


0 


5 


Z3 


0 


0 


0 


1 


1 


1 



Note the points that satisfy (IV 12) at equality, but are not in the polytope P E . Since we 
only have 3 points x € P E that satisfy (IV 12) at equality, and the dimension of P E is 4, we 
cannot possibly have four affinely independent points that satisfy (IV 12), so (IV 12) cannot 
be a facet. 

End example 3 

d. Tightening 

In the previous section, we developed a procedure to generate strong cuts 
and facets for elastic knapsack constraints with an implicit upper bound z = aj — bon 

j€N 

the constraint violation variable 2 . When 2 < JP aj — 6 , the elastic knapsack constraint will 

j€N 

not allow all variables to be set to 1 at the same time, and some of the variables lifted into 
the EMCC may require coefficients greater than one. We can use the tightening Procedures 
3 or 4 from Chapter III by deriving the appropriate coefficients Uj for variables x 3 as if they 
belonged to the knapsack constraint 

ajXj <6 + 2 . 

jeN 

To use Procedure 3, the elastic cover must be tight, that is 

^2 a j ~ b + 2 + 1. 

If the elastic cover is not tight, Procedure 4 must be used. To use either procedure, substitute 
b 4- 2 for b. The EMCC is then tightened to 

yi x i jr u 3 x 3 „ _ ^ - 1 £2 1 ~ i) 

;es: ,eE(SL)-SL £ 3 
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which is a strong cut (perhaps a facet) for the elastic knapsack polytope. 

We can also use these tightening procedures when S$ is not strong by ignor- 
ing any variables x if i e N — E(S$) that do not meet condition (IV7). But, in this case, we 
know that we will not form a facet. 

Example 2 (part b) Given the knapsack constraint 

20xi + 25x2 + 25x3 + 45x4 + 21x5 — z < 50, 

and z = 10, we tighten the cut formed in Example 2, part a, 

z 

X! + x 2 + X 3 + x 4 - — < 2, 

by rewriting the constraint with the substitution b + z for b : 

20xi + 25x 2 + 25x 3 + 45x 4 + 21xs < 50 + z = 60. 

Since ^ a j > b + z + 1, we use the Procedure 4 lifting process in Chapter III. Thus, we 
assign u; 4 = 2, and the new valid inequality is 

z 

x \ + x 2 + x 3 + 2 x 4 — — < 2. 

End example 2 (part b) 

Note that we ignored the variable X5, the variable that, through interior lift- 
ing, removed the violation. Our lifting process is still valid, but we forego the possibility 
of finding a facet of the elastic knapsack polytope. 

4. Non-Standard Elastic Knapsack Constraints 

We consider a variant of (IV 1) where one or more aj > b, j e N. When an elastic 
minimal cover is found with one of the variables having such a constraint coefficient, the 
valid inequality (and cut) derived is altered. Define 

s ? = UWj > e s?} , 
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and let a 

Jmui 

inequality is 



= min a.j. For any elastic minimal cover containing such a variable, the valid 

jess 



Xj " 1 " X^ u j x 3 a> _ u — — T 

jes'~ jeE(S'~)-si • Jmin 

where the coefficient of 2 has changed from ^ i _ b to a > 1 _ b - The cut-finding problem 

jtsL 3 >min 

must be amended to reflect this coefficient change as well. 

We also can derive cuts for another elastic constraint, 



djXj + z > b. 

jeJ 

After a simple conversion, discussed in the next section, the constraint becomes of form 
(IV 1), and all procedures in this section can be applied. 



B. KNAPSACK CONSTRAINTS WITH NON-STANDARD SENSES 

All our results thus far have been for the knapsack polytope associated with the 
“standard” form 



ajXj < b. (IV 13) 

j€N 

Our results are easily adapted for knapsack constraints 

Y a i x i > b ( IV14 ) 

jeN 

and 

Y a i x i = b 

j£N 

where a.j and 6 are positive integers, xj are binary variables, and N = {1, ..., n}. 

1. Greater-Than-Or-Equal-To Knapsack Constraints 

We use our existing algorithms by simply converting (IV 14) to the form of (IV13). 
This is accomplished by replacing the variable x j with its complement (1 — y ; ). (Crowder, 
et al. (1983) substitute complementing variables to convert less-than-or-equal-to knapsack 
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constraints with one or more negative coefficients a, to (IV13).) Thus, by the substitution 
in (IV 14), we have 

'y ' — Dj) ^ 

j<=N 

the new standard knapsack constraint is 



J2 a >y> 2 2 Z a > - b ( IV15 > 

jeN jeN 



where aj and a-j — b are positive integers, the yj are binary variables, and N = { 1 , ..., n). 

je N 

Once (IV 15) is formed, we find the complementary LP solution values y ) — 1 — Xj. 
We then apply one of the cut-finding problems and, if an XVMCC or an NMCC exists, all 
lifting and tightening procedures are applied and we find a facet 



y ] yj + y ^ ^ jUj 5- 1 <5 1 i. 

ies' je s' 

We now transform the facet back into the original variable space before appending it to the 
MIR The facet added to the MIP is 



'y^, x j+ yi u j x j ' u j + 1- 

jes- je s' jes' 

Example 4 Suppose the solution to the LP relaxation of a MIP with knapsack constraint 

4xi + 4x2 + 2 x 3 + 2 x 4 + 5 x 5 + 3x6 + 9 x 7 + 3x8 + 8 x 9 > 30 
is 

3 ^ ^ ^ 4 ^ ^ ^ ^ 

Xi = t,x 2 = 0 , x 3 = 0 ,x 4 = 0 , x 5 = -,x 6 = l,x 7 = l,x 8 = l,x 9 = 1 . 

4 5 

The knapsack constraint has two fractional variables. The transformed knapsack constraint 
4y\ + 4 2/2 + 2j/ 3 + 2 y 4 4- 5y 5 -I- 3ye + 9 yi + 3y$ + 8yg < 10 
has a transformed LP solution of 

£1 = V2 = 1, V3 = L y* = L 05 = g. Vi = 0 v j > 5 
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The solution to the XVMCC-finding problem is an XVMCC with minimal cover S = 
{1,2, 3, 4} 

y\ + V2 + 2/3 + 2/4 < 3. 

Applying Procedures 1 , 2 and 3 yield the facet 

2/1 + 2/2 + Vz + 2/4 + j /5 + 2/6 + 3j/ 7 + 2y 9 < 3. 

Transforming back to the original variable space yields the facet 

x\ + x 2 + £3 + X4 + £5 + xq + 3x7 H - 2x9 ^ 3 

which is now appended to the MIP to cut offx. 

End example 4 



Equality Knapsack Constraints 



We can use our existing algorithms for knapsack constraints with equality senses, 
also. First, we convert 

a jX j b 

j£N 

to 

]T a jXj < b (IV 16) 

jeN 

and 

a i x j > b. (IV 17) 

j€ N 

Then we convert (IV 1 7) by complementing, and apply all applicable procedures from Chap- 
ter III to both constraints that are now of the form (IV 16). 

Example 5 Suppose the solution to the LP relaxation of a MIP with knapsack constraint 



2xi + 2x2 + 3x3 + 4 x 4 = 5 



is 



xi = 1, x 2 = 1, x 3 = x 4 = 0. 
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We can represent the constraint by 



2x\ + 2^2 -b 3x3 + 4 x 4 — 5 



(IV 18) 



and 



2xi + 2x2 + 3x3 + 4 x 4 > 5. 



(IV 19) 



The lifted and tightened minimal cover cut for (IV 18) is 

Xl + X 2 + £3 + 2x 4 < 2. 

We transform (IV 19) by complementing, which yields 



A minimal cover cut for (IV20) is 

2/3 + 2/4 < 1. 

Transforming back to the original variable space yields the cut 

X3 + x 4 > 1. 

Both cuts are now appended to the MIP to cut off x. 

End example 5 



22/1 + 2 i /2 + 3 j / 3 + 4 1/4 < 6, 



(IV20) 



with a transformed LP solution of 



2/1 = 0, 2/2 = 0, y z = 2/4 = 1. 
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V EXPLICIT-CONSTRAINT BRANCHING 



In this chapter we develop the new technique of “explicit-constraint branching” 
(ECB) to improve the branch-and-bound portion of composite enumeration. Special Or- 
dered Sets and Foster and Ryan’s branching technique for overlapping set-partitioning con- 
straints (Foster and Ryan, 1981) demonstrate how constraint branching can improve the so- 
lution process for MIPs, but these implicit-constraint-branching techniques require a special 
problem structure. ECB adds structure to a MIP by adding new constraints and new inte- 
ger variables and does not require any special relationships within the problem structure. 
Like implicit-constraint branching, the goal of ECB is to moderate the branching process 
by more “evenly” partitioning the feasible region of the LP relaxation of the MIP The value 
of this simple technique is demonstrated by empirical evidence presented in Chapter VI. 

A. INTRODUCTION 

ECB adds one or more constraints of the form 

^2 a i x i -yi = ° ( V1 ) 

jeJi 

to a MIP where J is the set of indices of integer variables of the MIP are integer constants, 

Ji C J, and the yi are general integer “branching” variables. For reasons discussed later, 
we assume a ; = 1 for all j € Ji in the following discussion. 

Each ECB constraint is created (with a 3 - = 1 V j 6 J ; ) to allow the branch-and- 
bound process to branch on a sum of integer variables before branching on any individual 
integer variable in the sum; intuitively the sum should be integer before all of the individual 
variables in the sum need be integer. We implement this by setting the “branching priority” 
higher for the branching variable yi than the x j in the branch-and-bound algorithm. (Modem 
integer-programming solvers usually allow this branch-and-bound option.) Then, whenever 
branch and bound sees an intermediate solution with some non-integer y i, branching derives 
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the two restrictions for the MIP at the current node 



Vi < lyi\ or yi > L^iJ + 1. 

Branch and bound will only derive restrictions from a fractional x 3 when all are integer, 
continuing to do so unless some y, becomes non-integer again. 

The following series of examples demonstrate how ECB might be applied. First, 
we repeat the example of Chapter I to illustrate ECB where only a single ECB constraint is 
added, and to illustrate the potential effectiveness of the technique. 

Example 1. Recall the binary IP of Example 2, Section 1.3: 

maximize 

subject to: 

Variable-based branch and bound forms a partition based on the one fractional variable, 
which we designate as x 3f , and derives the restrictions 



E x 3 

E2 *;-< 2 I ^ I rl ' 

jeJ L J 

Xi 6 10,1) V? € J. 



Xjj < 0 or Xj f > 1 . 



The process of fixing variables and fathoming nodes continues until all j) alternate 
optimal solutions are found and the first is declared optimal. 

We reduce the amount of nodes branch and bound must enumerate by adding an 
ECB constraint and creating the problem 



maximize 



E 



< 2 



2 



+ 1 



subject to: E 

j€J 

E x 3 -y = 0 

3€J 

Xj € {0, 1} Vj 6 J 

y 6 {0, 1, 2, ..., |Jj} . 

The variable-based branch-and-bound partition based on y derives the restrictions 



y < 



\J I 



or y > 



U\ 



+ 1) 
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and branch and bound evaluates only three LPs before the problem is solved. Thus, by 
branching on the sum of integer variables, we solved the IP without fixing any binary vari- 
ables. 

End Example 1 

Another example demonstrates how a single ECB constraint might be used with set- 
packing, set-covering, and set-partitioning problems, and hybrid versions of these problems. 

Example 2. 

part (a). Consider an IFJ 

minimize ^ CjX 3 
jeJ 

subject to: a v x j S lV* = l,...,m 

j€J 

x j € {0, l},j€ J, 

where the a tJ E {0,1}, constraints with a sense of < are set-packing constraints, constraints 
with a sense of > are set-covering constraints, and constraints with a sense of = are set- 
partitioning constraints. An obvious requirement for any solution of this class of problems 
is that the sum of all binary variables be integer. This requirement can be satisfied in a 
branch-and-bound algorithm (before requiring all binary variables to be integer) by adding 
the construct 



5^ x i - y = o. 

jeJ 

where y > 0, and integer. Again, the branching priority' is set higher for y than for the xj. 

part (b). 

A specific example demonstrates how one ECB constraint can reduce the work of 
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the branch-and-bound algorithm in a set-packing IP Consider the set-packing IP: 

K 

maximize £ (x fcl +x k2 +x k3 ) 

fc=i 

K 

subject to: J2 ( x h + x k 3 ) < 1 

k = 1 

K 

Z) (x^ +Xfc 2 ) < 1 

k = 1 

K 

Z y ( X *2 + X fc 3 ) < 1 

fc=l 

k\ i x & 2 , x/j 2? £ {0,1), A: 1 , . . . , .If . 

This problem consists of a set of if “odd cycles” of length three (e.g., Hoffman and Padberg, 
1 993). Without loss of generality, we may assume that an optimal LP extreme point solution 
will be of the form 



xij x^ 2 x^j f x kl x^ 2 %k 3 — 0 V A, > 1. 

It is relatively straightforward to see that the best-case branch-and-bound scenario must 
solve approximately K LPs, and the worst-case scenario must solve approximately 3 K 
LPs before a declared optimal solution is found. 

By adding an ECB constraint 

K 

T, (xfcj + xfc 2 + xfc 3 ) - y = 0 

fc=i 

and branching on y first, our initial separation will be 

K K 

y (x kl + Xfc 2 + Xfc 3 ) < 1 or 'y (x kl + Xfc 2 + Xfc 3 ) > 2. 
k= 1 k = 1 

The LP resulting from the second constraint is infeasible, and the LP resulting from the first 
constraint finds a declared optimal solution to the problem, since all feasible LP extreme 
points have some x ki = 1, and all the other variables 0. 

Larger problems with sets of these constraints embedded in the constraint set can be 
handled with cuts of the form 



Xfcj + Xfc 2 4- x fc3 < 1 V k = 1, ..., I< 
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but this entails first searching for and finding all sets of odd cycles. ECB deals with this 
issue without such overhead. 

End Example 2 

Example 3 Consider an IP for a capacitated plant location problem: 



minimize 


71 771 

X^X3 C ij x ij 


+ EM- 










i—lj—1 


i=i 








subject to: 


X^ X V 
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Vi 




i=l 
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V i 



where Dj is the demand associated with customer j and K{ is the capacity of the plant 
located at i. If z* = 1, then a plant is located at i, and if = 1, then customer j’s demand 
is satisfied by the plant located at i. 

Before we form any ECB constraints, we set the branching priority higher for the 
plant location variables z* than the branching priority for the customer variables x rj . This 
ensures that branch and bound decides which plants are opened before deciding which indi- 
vidual customers will be served by a plant. (This is equivalent to the “propagation branch- 
ing” described by Guignard and Spielberg (1977).) We also add the ECB constraints 

771 

y: ~ yi = o v i. 

3 - 1 

to ensure that the sum of the customers for each opened plant is integer before branching 
on any individual customer. Branching priorities p w for variable w are set as follows: p Zt > 
Pyi > Puj » where the largest priority is branched on first. 

End Example 4 

In similar problems where the number of facilities, such as plants, warehouses, or 
distribution centers is not fixed but is perhaps bounded (Geoffrion and Graves, 1 974), it 
makes sense to add an ECB constraint to ensure that the number of facilities opened is in- 
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teger before branching on sums of customers. In our plant location example, if we replaced 
the requirement to open k plants with an upper bound of k instead, we could add the ECB 
constraint 

n 

5 >-* = ° 

2 = 1 

where y e (0,1,2, and assign branching priorities p y > p Zi > p y . > p x ... 

B. GENERAL EXPLICIT-CONSTRAINT BRANCHING 

We define two different variants of ECB. “Basic ECB” allows a variable to appear 
at most once in an ECB constraint. The added constraints are 

^2 ~ Vi = °’ (V2) 

jeJi 

where the J, are all disjoint subsets of J ; the iji are assigned higher branching priorities than 
the Xj. 

“Nested ECB” uses the subsets of the variables from basic ECB constraints to add 
constraints of the form 



y, Xj - Vi k = 0, k = 1, 2 , ..., m, 

j£Ji k 

where J ik C J,, and all J ik are disjoint. In this case, the y { are assigned higher branch- 
ing priorities than the y ik , which in turn are assigned higher priorities than the Xj. We can 
recursively form more nested constraints from each previously formed nested constraint 
(Ji kq C Ji k , q = 1, 2, ..., Q), so that we have multiple “levels” of nesting, and thus multiple 
levels of branching variables where the priorities are commensurately assigned. 

Nested constraint branching could also be implemented using a “bottom up” ap- 
proach. Let Ji U J 2 U ... U J m = J define a partition of J, and create the bottom level of 
ECB constraints 

y Xj - yk = 0 , k = 1 , 2 , ..., m. 

jeJk 
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Then, form the next two levels 



^2 y*-y'e = 0 ’ 

heK e 

X>;-i4'=o, 

eeL p 

and so on. Branching priorities would be determined so that p Xj < p yk < p y > ( < p y », etc. 
This bottom-up approach to nested ECB is not implemented in this dissertation. 

C. CONSTRAINT-BRANCHING PROCEDURES 

We distinguish between different applications of branching techniques. A static pro- 
cedure adds branching constraints before the MIP solution procedure has begun. In practice, 
we decide the number and composition of ECB constraints to add for a static procedure by 
examining of the constraint set of the MIP A dynamic procedure adds branching constraints 
during the branch-and-bound process, using information gleaned from solutions of LP re- 
laxations at nodes of the enumeration tree. This procedure is similar to the cutting-plane 
procedure called “branch and cut.” One such dynamic procedure has been used by Jom- 
sten and Varbrand (1991) to solve generalized assignment problems. These authors refer to 
the technique as “generalized branching” and credit Jomsten and Larsson (1988). Implicit- 
constraint branching is another dynamic procedure that uses solution information from the 
LP relaxations in the branch and bound to partition the set of variables. We have developed 
“semi-dynamic ECB” that uses LP solution information to determine the composition of 
the added ECB constraints. We explain semi-dynamic ECB in the context of nested ECB 
in Section D. We consider only static and semi-dynamic procedures in this dissertation. 

D. APPLICATIONS 



1. Basic ECB 

Problem structure will often dictate how basic static ECB constraints should be 
added. For instance, in the generalized assignment problem (GAP), defined in Chapter 
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II, there are knapsack constraints 



^ ^ h-ot^ot — Hu 

oeo t 

x ot G {0, 1}, for each truck t. It is intuitively appealing to enforce the requirement that 
“the sum of order variables on a truck must be a general integer” before enforcing the 
requirement that “each order variable on a truck must be binary.” Furthermore, there are 
many fewer of the former requirements to satisfy (typically, |T| <<J2 |O t |), and satisfying 

t 

them first may achieve satisfaction of the latter requirements with little or no additional 
work. This enables us to solve, or nearly solve, the GAP by branching a modest number of 
times on a small number of general integer variables rather than branching many times on 
a large number of binary variables. 

We implement basic ECB by adding the following constraints to the GAP: 

Xot - Vt = o V t € T, 

oeo ( 

where the y t are general integer variables. This modified GAP has \T\ new constraints that 
must be satisfied and |T| new integer variables that must be solved for. We hope that the 
additional burden placed on the LP solver embedded in the branch-and-bound algorithm, 
(LP solvers operate, on average, in polynomial time), is outweighed by the potentially ex- 
ponential reduction in the number of LPs that must be solved. 

We could form the ECB constraints 

J2 h ot x ot -y t = 0Vt€T, (V3) 

oeOt 

which correspond to our original definition (VI), and treat y t as a general integer branching 
variable, but at any node, the two restrictions 

Vt < [yt\ or y t > [y t \ + 1 

may be imprecise, that is there may not exist any set 0' t C O t such that ^ h ot = [y t J or 

oeo' t 

5Z hot = L2/fJ + f 

oeO’ 
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To efficiently branch with an ECB constraint of the form (Y3) entails finding the 
feasible values of y t : y' tl ,y' t2 , y ' t3 , ..., y' tm , perhaps by dynamic programming, and enforce 
branchings so that if 

y' tk <m< y' tk+1 , 

then the branching rule will be 



Vt < y't k Or y t > y[ k+i , 

where possibly y't k+l -y[ k # 1- It is possible to branch on y t where the values y' tl ,y' t2 ,y' t3 , ■■■,y' trn 
are specified by a sequence with some solvers (e.g., the XA Solver, ( GAMS-The Solver Man- 
ual, 1993)), but we are not guaranteed that the feasible values of y t will correspond to any 
given sequence. We will not pursue this constraint branching technique in this dissertation. 

2. Nested ECB 

When using nested ECB, it is important to remember that our goal is to reduce the 
amount of work the variable branch-and-bound process must do. If we add too many ECB 
constraints, we can easily defeat this purpose. For example, we could add an ECB constraint 
(Y2) and then split J x into two disjoint subsets J lm and J, n and add constraints for them. If 
we recursively continue this process until we eventually form ECB constraints containing 
a single binary variable, then we have added many more general integer variables than the 
number of binary variables that we began with, which will likely be counterproductive. In 
practice, we have discovered that adding only a few nested ECB constraints for each basic 
constraint works well. The decision of the number of ECB constraints to add and their 
composition depends on the procedure that is used. 

a. Static ECB 

For static nested ECB, we use the number of variables Xj in the basic ECB 
constraint to determine the number of nested constraints to add to a problem. In general, for 
each set of variables J t - C J, (where J is the set of variables in the problem), the technique 
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adds an ECB constraint 



53 x i “ Vi = °> ( V4 ) 

jeJi 

where is a general integer variable, and then adds constraints 

53 x i ~ yi * = °> k 6 K ’ 

jeJr k 

n 

where = {1, J t * = U J t - fc and J* m n J; = 0 V m,p € K . When adding these 

/c=l p 

constraints to a MIP, we set branching priorities such that y t has the highest priority, the y ik , 
k € K, have the next highest priority, and the xj have the lowest priority. 

We apply nested ECB to the GAP by adding the basic ECB constraints 

J2 Xot - Vt = 0 V t 6 T, (V5) 

oGO t 

and then adding only one level of nested constraints 

Xot - y tk = 0 V t 6 T, \fk e K t , 

°eOt k 

where the O tk are disjoint sets of variables in the nested ECB constraints, O tk C O t V 

\K t \ 

k, K t is the set of indices of the nested ECB constraints, and U O tk = O t . For this 

fc = 1 

application, \K t \ depends on \O t \ ■ For our test problems, we have found that if \O t \ is 
small, say \O t \ < 8, it makes little sense to form any nested constraints, and the basic ECB 
constraint will suffice for that particular knapsack constraint. If 8 < \O t \ < 16, we add 
| K t \ = |jOt| /2J = 2 nested ECB constraints, each of which will also have at least four x ot 
variables. If \O t \ > 16, we create \K t \ = [|O t |/2J = 4 nested ECB constraints, each of 
which will have at least four x ot variables. 

When using the technique of nested ECB as described above, there is always 
a redundant ECB constraint formed. Thus, we omit one of the nested ECB constraints when 
using this technique. 

Lemma 5.1 When partitioning the variables in a basic ECB constraint into \K\ disjoint 

n 

subsets such that K = {1, ..., n}, J* = U Ji k and J im D J tp = 0 V m, p E K, only n — 1 

k= 1 1 
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nested ECB constraints need to be added to achieve the branching effect ofn nested ECB 
constraints. 

Proof. Consider the basic ECB constraint 

53 x 3 -yi = °- (V6) 

jeA 

In order to add the n nested constraints, we partition the variables j £ J t into n disjoint 

n 

subsets such that K — {1, n}, f = U J ik and J im n J iv = 0 V m, p £ K. Now, we form 

k— 1 v 

the n constraints of the form 

J2 x i = Vht- 

jeJ lk 

If we add the first n - 1 nested constraints, when y l and y lk are integer for A: = 1, 2 , n — 1 , 
the higher branching priority of y* ensures that 

53 x i = y i_ yi i - ••• - v*- 1- Q ED 

3ZJ*n 

We have discussed one example of adding nested constraints in the context 
of static ECB. Next, we discuss how we use a semi-dynamic procedure to form nested ECB 
constraints. 



b. Semi-dynamic ECB 

Semi-dynamic ECB uses information from one or more LP solutions to de- 
termine the composition of the nested ECB constraints. We can implement this technique 
by simply solving the LP relaxation of the IP, order the fractional variables in some mean- 
ingful way (perhaps focusing on those variables with Xj « . 5 ; i.e., “furthest” from being 
integer), and apportion the most important fractional variables as evenly as possible among 
the nested ECB constraints. 

When we combine ECB and knapsack constraint generation in composite 
enumeration, we have information from the LP solutions in the constraint generation phase 
that we can heuristically use to decide how to implement ECB. In the constraint generation 
phase, we typically solve an LP generate knapsack cuts (if they exist) for each knapsack 
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constraint, solve the modified LP and recursively generate cuts and solve LPs until no more 
knapsack cuts can be found. 

To implement semi-dynamic ECB, we form a vector f, and use it to record the 
number of LP solutions fj in which the variable xj is fractional in the constraint generation 
phase. We use this information to decide the composition of the subsets of variables for 
each nested ECB constraint and also use the information to decide how many nested ECB 
constraints will be added for a particular basic ECB constraint. Intuitively, we hope that 
variables that are nearly always integer (fj small) in the constraint generation phase will 
stay integer in the LP solutions during the branch and bound. This should allow our nested 
ECB constraints to focus on the variables that are more likely to be fractional in the branch 
and bound (fj large). 

Just as with the description of SOS Type 1 in Chapter I, we would like to 
choose subsets of variables so that those with fractional Xj are evenly apportioned among 
all subsets. If there are \K t \ nested ECB constraints to be added, then the variable that 
has been fractionated the most is placed in subset J tl , the next most fractionated variable 
is placed in J, 2 , and so on until the first \K t \ variables are each placed in separate ECB 
constraints. The (|ff £ | + l)st variable is then placed in subset J ix , the (\K t \ + 2)nd in J* 2 , 
and so on until all variables are placed in a subset, effectively distributing the most-often 
fractionated variables fairly evenly among the \K t \ nested constraints. 

3. Comparison of Dynamic and Static Techniques 

After developing the technique of ECB, we discovered a reference in Jomsten and 
Varbrand (1991) to a technique called “generalized branching” developed by Jomsten and 
Larsson (1988). (The original research report is unavailable at this time.) They describe 
two different branching techniques for the generalized assignment problem, but the one 
that resembles ECB is of interest here. Their dynamic technique at a node vj examines the 
knapsack constraints 

^ ' hotpot ^ Hi, 

oeo t 

and checks to see if ®ot is fractional in the solution to LP ( j ). If so, the restrictions 

o€0, 
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derived at vj are 



^ ^ %ot ^ 


y: Xat 


or ^ x ot > 


t: x °t 


oeO £ 


-oeo t 


oeo t 


.oeo t 



Thus, LP (j i) at Vj x is LP ( j ) with the first restriction added, and LP (j 2 ) at v J2 is LP (j) 
with the second restriction added. This means that for each truck t. there is a constraint 
added each time ^ x ot is fractional and chosen to derive restrictions at a particular node. 

o60 ( 

Static basic ECB in our GAP application described in Section V2 will branch in exactly 
the same way, except we have no need to modify the standard variable-based branch and 
bound. Because we have added a basic ECB constraint for each knapsack constraint in the 
GAP, 

oeOt 

and set the branching priority higher on the y t than for the x ot , branch and bound will enforce 
the same constraints explicitly added by generalized branching by simply enforcing the 
branching priorities specified by the ECB technique. 
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VI. COMPUTATIONAL RESULTS 



Knapsack cuts and explicit-constraint branching have been implemented and tested 
on sets of generalized assignment problems (GAPs). Explicit-constraint branching has also 
been tested on set-partitioning and other problems. We begin by giving an overview of 
the implementation. Then, we summarize computational results from a set of 84 randomly 
generated GAPs. (Detailed results of these problems are presented in the Appendix.). We 
present detailed results of eight real-world GAPs (standard and elastic) from the petroleum 
industry and several binary integer problems, including some set-partitioning problems. 

The composite solution algorithm is coded in C and uses CPLEX 3.0 ? s callable li- 
brary (CPLEX, 1993) to solve linear programming relaxations and to perform branch and 
bound on the integer program as modified by our techniques. If knapsack cuts are to be 
added to an IF| an LP is solved, and a knapsack cut is added for each eligible knapsack 
constraint if such a cut exists. This procedure is iterative, so if any cut is added in the 
first iteration, a new LP is solved in a second iteration, cuts are again derived from eligi- 
ble constraints, if possible, and so on. Cuts added in previous iterations are candidates for 
cut generation as well since they are also knapsack constraints. This iterative process ter- 
minates when no more cuts can be found, or after 20 iterations of adding knapsack cuts, 
whichever occurs first. Then, if ECB will be used, ECB constraints and variables are added 
and branching priorities are specified for the general integer branching variables. After 
all knapsack and ECB constraints are added, the modified IP is then solved by CPLEX’s 
branch-and-bound solver. All CPU times reported here are from an IBM RS-6000 Model 
590 with 512 megabytes of random access memory. We allow a maximum of 1000 CPU 
seconds with a relative optimality criterion of 0.5% for all GAPs. Optimality criteria for 
other problems are specified elsewhere. 

A. GENERALIZED ASSIGNMENT PROBLEM 

The GAP is difficult; real-world problems with as few as 200 variables cannot be 
solved with standard branch and bound. We use two sets of GAPs to test knapsack cuts and 
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basic ECB. The first set consists of 84 randomly generated problems taken from the liter- 
ature (Osman, 1994, Beasley and Chu, 1995, Cattrysse et al., 1994, Beasley, 1997). These 
problems allow each order to be delivered by each truck. The second set of eight real-world 
problems (Brown, 1995) has many orders that can only be delivered by specific trucks; this 
apparently makes these problems more difficult to solve than randomly generated GAPs of 
comparable size. 

The basic formulation of the GAP (in terms of delivering orders on trucks) is 
minimize E E c otx Q t 

oeOteT 

subject to: E x ot — 1 Vo (ORDERS) 

t&T 

E h °otXot < H t Vt (TRUCKHOURS) 

o€0 1 

x ot € {0, 1} Vo € Ou t £ T 0 . 



(A complete description of the GAP with all data, indices, and variables defined appears in 
Chapter II.) To implement explicit-constraint branching, the GAP is modified to 



minimize E E c otx 0 t 

oeOteT 

subject to: E x °t 

teT 0 

El h 0 tXot 
oeO t 

E x ot 

o€Ot 



Xot 



= 


1 Vo ( ORDERS ) 


< 


H t 'it ( TRUCKHOURS ) 


-yt = 


0 Vi 


€ 


{0, 1} Vo € O t , t € T a 


yt e 


{0,l,...,|O t |} Vt. 



B. RESULTS FOR RANDOMLY GENERATED GAPS 

We summarize the problem size and results for the 84 randomly generated GAPs in 
Tables 2, 3 and 4; detailed results appear in the Appendix. These problems are solved with 
a maximizing objective function. The notation used in the tables of results is: 

BandB. Branch-and-bound solver only. We attempt to solve these problems using only the 
CPLEX branch-and-bound solver, branching on the variable with maximum infeasibility. 
(This branching option was used throughout all computational tests.) 
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# Variables 


Trucks 


Orders 


Constraints 


Variables 


<1000 


7 


40 


47 


300 


>1000 


13 


160 


173 


2000 



Table 2. Average problem size for randomly generated GAPs. There are 64 problems with under 1000 variables, and 20 
that have at least 1000 variables. 

KS. Knapsack cuts are added before applying the CPLEX branch and bound solver to the 
modified IP 

ECB. ECB constraints and variables are added and branching priorities specified before 
applying the CPLEX branch and bound solver to the modified IP 

KS/ECB. Knapsack cuts and ECB constraints and variables are added and branching pri- 
orities specified before applying the CPLEX branch and bound solver to the modified IP 
Solved. Percentage of the problems that were successfully solved in under 1000 CPU sec- 
onds. 

CPU secs. The average time in seconds required to solve each problem that could be solved 
in under 1000 CPU seconds. 

Nodes. The average number of nodes in the branch-and-bound tree required by each prob- 
lem that was solved in under 1000 CPU seconds. The letter “K” indicates thousands of 
nodes. 





BandB 


KS 


ECB 


KS/ECB 


Solved 


40.6% 


100% 


100% 


100% 


CPU secs 


88.2 


4.3 


6.9 


2.9 


Nodes 


33K 


451 


1022 





Table 3. Summary of computational results for random GAPs with fewer than 1000 variables. An average of 22 knapsack 
cuts are added per problem for each solution procedure using knapsack cuts (KS and KS/ECB). The average time and 
nodes for branch and bound reflects only those problems that were solved in under 1000 CPU seconds. 



As seen in Table 3, over half of the smaller GAPs cannot be solved by standard 
branch and bound alone, but any of the techniques developed in this dissertation will solve 
all 64 of these problems. Table 4, which covers the large problems, also demonstrates the 
inability of standard branch and bound to solve GAPs. More importantly, it demonstrates 
that some of the larger GAPs cannot be solved when knapsack cuts or ECB are applied 
individually, but used together, these techniques solve all of the randomly generated GAPs. 
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BandB 


KS 


ECB 


KS/ECB 


Solved 


30% 


80% 


90% 


100% 


CPU secs 


352.5 


113.0 


26.5 


70.1 


Nodes 


49K 


3731 


1596 


724 



Table 4. Averaged results for random GAPs with 1000 variables or more. An average of 42 knapsack cuts were added 
for each problem successfully solved with knapsack cuts and branch and bound, and an average of 48 knapsack cuts were 
added for each problem solved with knapsack cuts, ECB and branch and bound. “CPU secs” and “Nodes” reflect average 
data for those problems solved in under 1000 CPU seconds. 

C. RESULTS FOR REAL-WORLD GAPS 

Here we test ECB and knapsack cuts on a set of eight real-world GAPS from the 
petroleum industry. Table 5 lists the basic statistics for these problems. 



Model Name 


Trucks 


Orders 


Constraints 


Variables 


LONGD 


8 


22 


30 


46 


LONGN 


6 


21 


27 


37 


BOSTD 


17 


56 


73 


330 


BOSTN 


15 


50 


65 


266 


DLWRD 


19 


70 


89 


469 


DLWRN 


11 


48 


59 


200 


LOSAD 


34 


151 


185 


1835 


LOSAN 


35 


147 


182 


1790 



Table 5. Problem statistics for real-world GAPs. 



Table 6 lists solution times and the number of branch-and-bound nodes for all solu- 
tion techniques applied to these GAPS. However, four of the problems are infeasible (de- 
noted “INF” in the “Time” column) because not all orders can be delivered in the time 
allotted to the trucks. These problems must be “elasticized” in order to obtain feasibility. 
We address solving the elastic version of these GAPs later in this chapter. 

Ignoring the infeasible problems. Table 6 shows that knapsack cuts solve only one 
real-world problem when used alone. This stands in sharp contrast with the randomly gener- 
ated GAPs. ECB solves all problems with the exception of DLWRD. As with the randomly 
generated GAPs, all (feasible) problems are solved when ECB and knapsack cuts are com- 
bined. 
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Model 

Name 


BandB 


KS 


ECB 


KS/ECB 


Time 


Nodes 


Time 


Nodes 


Cuts 


Time 


Nodes 


Time 


Nodes 


LONGD 


INF 


N/A 


INF 


N/A 


N/A 


INF 


N/A 


INF 


N/A 


LONGN 


INF 


N/A 


INF 


N/A 


N/A 


INF 


N/A 


INF 


N/A 


BOSTD 


(1000) 


(151K) 


(1000) 


(138K) 


41 


11.10 


2234 


31.62 


4439 


BOSTN 


(1000) 


(158K) 


(1000) 


(133K) 


44 


11.47 


2920 


3.89 


255 


DLWRD 


(1000) 


(119K) 


(1000) 


(11 IK) 


57 


(1000) 


(119K) 


19.22 


2187 


DLWRN 


(1000) 


(146K) 


5.82 


1050 


40 


1.66 


60 


3.28 


109 


LOSAD 


INF 


N/A 


INF 


N/A 


N/A 


INF 


N/A 


INF 


N/A 


LOSAN 


INF 


N/A 


INF 


N/A 


N/A 


INF 


N/A 


INF 


N/A 



Table 6. GAP solution results. Time is in CPU seconds. Problems with CPU time ‘‘(1000)” could not be solved in 1000 
CPU seconds. Nodes are the number of nodes in the branch and bound enumeration tree (“K” indicates thousands). The 
number of knapsack cuts added is the same for KS and KS/ECB solutions, so the information is only recorded once. 
Problems with ‘‘INF” in the “Time” column are infeasible in their present form, and require elastic constraints to insure 
feasiblity. 



D. RESULTS FOR REAL-WORLD, ELASTIC GAPS 



Here we investigate computation involving elastic GAPs. In particular, we modify 
the eight real-world GAPs by changing the knapsack constraints to allow penalized viola- 
tion. This can be thought of as allowing the trucks to operate in an overtime status with 
the penalty pf being the cost of the overtime for truck t. The four real-world problems 
that were infeasible can be solved with the addition of these elastic variables. The elastic 
formulation of the GAP with ECB constraints added is: 



minimize £ Yt c ot x ot + Yt Vt z t 
oeo t€T t€T 

subject to: Yt x ot 

teT 0 

Yt h 0 t x ot z t 

oeOt 

Yt x °t 

oeo t 

x ot 

zt 



— 


l 


V o 


6 


0 


< 


H t 


yt 


e 


T 


yt = 


0 


yt 


e 


T 


e 


{0,1} 


y o 


e 


0, 


e 


{o,i,. 


.,Hf} yt 


e 


T 


yt e 


{o,i,.. 


••,|O t |}Vi. Vi 


e 


T 



Table 7 shows solution times and the number of branch and bound nodes when each 
technique is applied to the elasticized GAR Interestingly, the table shows that the problems 
that were feasible and solved without the benefit of elastic constraints (compare with Table 
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Model 

Name 


BandB 


KS 


ECB 


KS/ECB 


Time 


Nodes 


Time 


Nodes 


Cuts 


Time 


Nodes 


Time 


Nodes 


LONGD 


1.69 


259 


2.19 


6 


5 


1.78 


4 


2.20 


12 


LONGN 


1.53 


82 


2.11 


95 


4 


1.48 


12 


2.11 


4 


BOSTD 


(1000) 


(170K) 


(1000) 


(129K) 


46 


2.50 


159 


3.52 


63 


BOSTN 


(1000) 


(183K) 


(1000) 


(132K) 


35 


1.75 


57 


3.00 


50 


DLWRD 


(1000) 


(113K) 


(1000) 


(102K) 


60 


(1000) 


(137K) 


8.61 


492 


DLWRN 


28.92 


10441 


7.99 


1393 


34 


1.75 


89 


3.10 


65 


LOSAD 


(1000) 


(79K) 


(1000) 


(49K) 


117 


(1000) 


(35K) 


199.03 


3725 


LOSAN 


(1000) 


(73K) 


(1000) 


(34K) 


181 


(1000) 


(36K) 


815.94 


13627 



Table 1 . Elastic GAP solution results. Time is in CPU seconds. Nodes are the number of nodes in the branch and bound 
enumeration tree. The number of knapsack cuts added is the same for KS and KS/ECB solutions, so the information is 
only recorded once. 

6) were all solved more quickly and with fewer nodes after being elasticized. More impor- 
tantly, problems that were infeasible are now solved. This table, like Table 4, reflects our 
general experience: The combination of ECB and knapsack cuts solves more problems than 
either technique applied in isolation. 



E. GAP RESULTS USING NESTED ECB 



1. Nested ECB Without Knapsack Cuts 

We first test nested ECB on problems that cannot be solved by basic ECB, or prob- 
lems that need more than 10000 branch and bound nodes to solve using basic ECB. “Nest 
n” refers to the addition of n nested ECB constraints, one of which is implicit. “SD” refers 
to semi-dynamic nesting which apportions variables to nested constraints using LP solution 
information. In this case, the apportionment is accomplished by solving one LP and apply- 
ing the distance metric described in Chapter V to LP solution values. “Static” implies that 
nesting was carried out by arbitrarily splitting the variables into the appropriate number of 
disjoint subsets, all of roughly the same size. All problems with “GAP” in the model name 
are from the set of randomly generated GAPs. 

The results, shown in Table 8, are varied. GAPllc is solved best by nesting four 
semi-dynamic constraints. GAP1 le solves more quickly using two static nested constraints. 
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Model 

Name 


Var 


Static Nest 2 


Static Nest 4 


SD Nest 2 


SD Nest 4 


Time 


Nodes 


Time 


Nodes 


Time 


Nodes 


Time 


Nodes 


GAPllc 


500 


98.63 


23824 


6.22 


1093 


28.10 


7397 


5.29 


1015 


GAPlle 


500 


39.84 


9601 


233.62 


53070 


123.44 


28546 


75.85 


16942 


GAPC3* 


1000 


(1000) 


(136K) 


253.59 


30443 


(1000) 


(133K) 


(1000) 


(132K) 


GAPA5* 


2000 


(1000) 


(87K) 


(1000) 


(92K) 


(1000) 


(84K) 


(1000) 


(98K) 


GAPC5 


2000 


(1000) 


(8 IK) 


(1000) 


(92K) 


(1000) 


(78K) 


(1000) 


(87K) 


DLWRD* 


469 


(1000) 


(120K) 


(1000) 


(11 8K) 


(1000) 


(118K) 


(1000) 


(11 IK) 



Table 8. Nested ECB without knapsack cuts. Time is in CPU seconds. Nodes are the number of nodes in the branch 
and bound enumeration tree. “\&r” indicates the number of variables in the problem. An asterisk (*) indicates that the 
problem could not be solved by basic ECB. 

More nesting is not always better as GAP1 le demonstrates. GAPA5 and DLWRD could not 
be solved by any type of ECB technique, and although GAPC3 was solved by nesting four 
constraints, the basic ECB solution was better. Note that the DLWRD problem (the only 
real-world problem) has the smallest number of variables, yet cannot be solved by any of 
the ECB techniques. 



2. Nested ECB With Knapsack Cuts 

We also test nested ECB combined with knapsack cuts. We select five problems that 
require over 1000 nodes to solve using basic ECB and knapsack cuts. The semi-dynamic 
apportionment is accomplished by recording the number of LP solutions (all solutions ob- 
tained during the cut-generation phase) in which a particular variable was fractional, and 
apportioning variables to the nested constraints based on the “propensity” of the variable 
to be fractional. 



Model 

Name 


Var 


Static Nest 2 


Static Nest 4 


SD Nest 2 


SD Nest 4 


Time 


Nodes 


Time 


Nodes 


Time 


Nodes 


Time 


Nodes 


GAPC3 


1000 


17.15 


1388 


31.77 


2968 


13.50 


992 


30.19 


3374 


GAPA5 


2000 


(1000) 


(50K) 


(1000) 


(70K) 


581.79 ] 


25980 


(1000) 


(69K) 


GAPB5 


2000 


7.14 


57 


175.18 


6388 


16.2 


392 


137.51 


5434 


BOSTD 


330 


19.18 


2536 


48.73 


5644 


29.3 


3619 


21.10 


2276 


DLWRD 


469 


150.91 


15523 


509.67 


47680 


876.44 


83274 


(1000) 


(87K) 



Table 9. Nested ECB with knapsack cuts. Time is in CPU seconds. Nodes are the number of nodes in the branch and 
bound enumeration tree. 



107 



The results, shown in Table 9, are again varied. GAPA5 and DLWRD do not benefit 
from nesting having better solution times with knapsack cuts and basic ECB. Semi -dynamic 
nesting with two nested constraints solves GAPC3 most quickly, while semi-dynamic ECB 
with four and static ECB with two nested constraints both solve BOSTD in about 20 CPU 
seconds, quicker than any other solution technique. GAPB5 solves quickly with both the 
static and semi-dynamic techniques using two nested constraints. In conclusion, we can 
say that nested ECB may be useful for solving certain problems, and sometimes the static 
technique will be better and sometimes the semi-dynamic technique will be. Computational 
testing will be necessary to determine if nesting is of value for a given set of problems. 

F. STRUCTURE-INDEPENDENT RESULTS WITH ECB 

Here we test structure-independent ECB on set-partitioning problems and other 
problems (MIPs) containing binary variables to demonstrate that special structure is not 
required to use ECB successfully. 

1. Set-Partitioning Problems and General MIPs 

Set-partitioning problems (SPPs) are difficult IPs to solve and tend to be much larger 
than GAPs. The basic formulation of the SPP is 

minimize c j x j 

jeJ 

subject to: a v x j = lVi = l,...,m 

j€J 

Xj e {0,1} Vje J, 

where a,j € {0, 1} . We implement ECB by using just one ECB constraint that ensures that 
the sum of all the variables in the problem is integer before branching on any individual 
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binary variable. The modified model is: 



minimize E c i x i 
j€-J 

subject to: E a ij x j = 

E x 3 ~y = 

j€J 

Xj e 

y e 



1 V i = 1 , m 
0 

{0,1} V; € J 

{1, rn}. 



A MIP can contain continuous, general integer and binary variables. We also test 
ECB on more general MIPs (than the SPP) by adding a single ECB constraint of the form 

E x j -y = o 

jzJ 

y € {0,i....,|J|}. 



Here, J is the index set for the binary variables in a problem and y is the added general 
integer branching variable. 



2. ECB Results 

To test structure-independent ECB, we obtained 12 integer problems from the MI- 
PLIB at Rice University (Bixby, et al. 1997) and two SPPs (SETP1 and PIB00) from the 
meat-packing industry (Brown, 1 997). We decided to use MIPLIB problems that branch 
and bound alone could solve in a reasonable time to a reasonable optimality criterion. We 
allowed 10000 CPU seconds, and solved to an optimality criterion of 0.5%. Results are 
shown in Table 1 0. 
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Model 

Name 


Total 

Vars 


Binary 

' irs 


Gen Int 
Vars 


BandB 


ECB 


Time 


Nodes 


Time 


Nodes 


setpT 


2564 


2564 


0 


68.4 


1608 


7.5 


37 


SETP2 


2564 


2564 


0 


23.2 


373 


8.6 


121 


PIB00 


377 


377 


0 


.6 


39 


.6 


4 


MODOOr 


319 


319 


0 


14.1 


5639 


1.6 


405 


CAP6000* 


6000 


6000 


0 


1983.4 


4654 


120.1 


776 


MISC03 


160 


159 


0 


8.8 


945 


14.1 


1270 


L152LAW 


1989 


1989 


0 


151.7 


3231 


156.9 


3381 


MISC06 


1808 


112 


0 


2.4 


20 


5.4 


53 


ENIGMA 


100 


100 


0 


1.5 


337 


1.6 


331 


LSEU 


89 


89 


0 


52.9 


25089 


61.3 


24721 


P0033 


33 


33 


0 


6.0 


5806 


7.6 


6081 


P0201 


201 


201 


0 


7.7 


855 


11.8 


1375 


DCMULTI 


548 


75 


0 


12.5 


1134 


30.6 


1429. 


RGN 


180 


100 


0 


15.1 


5275 


15.1 


5232 


BELL3A 


133 


39 


32 


13.2 


4516 


6.8 


2317 



Table 10. Solving binary integer problems with structure-independent ECB. Time is in CPU seconds. Nodes are the 
number of nodes in the branch and bound enumeration tree. “ Var" indicates the number of variables in the problem. SETP2 
is a modification of SETP 1 with adjusted penalties for constraint-violation variables. For all those problems marked with 
“f,” the CPLEX maximum-infeasibility branching strategy was used; that strategy was better than the default. Otherwise, 
the CPLEX default option was used which allows CPLEX to determine the branching strategy. 

ECB helped significantly with SETP1, SETP2, PIB00, MOD008, CAP6000 and 
BELL3A. L152L ENIGMA, LSEU, P0033 and RGN solved in about the same time and 
number of nodes by both methods. Branch and bound was the better solution option for the 
other four problems. 
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VII. SUMMARY AND RECOMMENDATIONS 



This dissertation has developed enhanced composite enumeration techniques for 
solving IPs and MIPs. Results demonstrate that previously unsolvable problems can be 
solved with these new techniques. This dissertation has specifically examined constraint 
generation from the knapsack polytope and “explicit-constraint branching,” a technique 
that applies constraint branching to IPs and MIPs that do not have the special problem 
structure required by “implicit-constraint branching.” 

A. CONTRIBUTIONS 

1. Knapsack Cuts 

In Chapter III, we developed knapsack cut-finding procedures for minimal cover 
cuts, and converted existing cut-strengthening theory into practical procedures that lift and 
tighten violated minimal cover valid inequalities to violated knapsack facets in polynomial 
time. We defined a new class of knapsack cuts called “non-minimal cover cuts,” cuts that 
do not contain a violated minimal cover cut, developed a dynamic programming procedure 
to find them, and developed a new method, “deficit lifting,” to lift them. Deficit lifting 
enables all non-minimal cover cuts to be lifted and tightened to violated facets as well. 

The minimal cover cut-finding procedure finds a maximally violated minimal cover 
cut, if one exists, in pseudo-polynomial time using dynamic programming. All violated 
minimal cover inequalities are lifted to strong cover cuts by a new procedure called “interior 
lifting.” The procedure that tightens strong cover cuts to violated facets improves upon the 
polynomial-time facet-finding algorithm of Zemel (1989). 

Extensions to knapsack cuts were developed for elastic knapsack constraints and 
non-standard knapsack constraints (those with greater-than-or-equal-to and equality senses). 
Elastic knapsack cuts are generated by an adaptation of the minimal cover cut-finding prob- 
lem of Chapter III. All the procedures of Chapter III were adapted for use with greater-than- 
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or-equal-to and equality knapsack constraints to allow the generation of facets or at least 
strong cuts for these types of constraints. 

2. Explicit-Constraint Branching 

The method of “explicit-constraint branching” was developed in Chapter V. This 
technique applies constraint branching to MIPs lacking the special structure required by 
standard “implicit-constraint branching” techniques. Explicit-constraint branching alone 
solves some MIPs that branch-and-bound cannot, and nesting the ECB constraints often 
solves more difficult problems. When combined with knapsack cuts, the synergistic effect 
of ECB with knapsack cuts solves still more difficult IPs. 

B. RECOMMENDATIONS FOR FUTURE RESEARCH 

This dissertation developed the new technique of explicit-constraint branching. Fur- 
ther study on nesting strategies and semi-dynamic techniques is necessary. ECB may prove 
to be effective (or not) for other classes of problems, and there may be different adaptations 
of ECB that could also prove effective for solving difficult problems. 

Finding violated knapsack facets that are not associated with any minimal or non- 
minimal cover cut is an area that requires further study. There could exist a relatively simple 
dynamic programming technique similar to our minimal cover cut-finding procedure that 
can find these violated facets. 

The implementation of “branch and cut” using easily generated, globally valid knap- 
sack cuts is warranted. In particular, globally valid knapsack cuts that were not apparent 
from the initial LP relaxations may become apparent and could be useful in solving the re- 
stricted problems of the branch and bound. This dynamic constraint generation technique 
could prove to be effective for solving problems such as the generalized assignment prob- 
lem. 

This dissertation has studied cuts based on special structure. We suggest further 
study of structure-independent cutting-plane techniques such as the Chvatal-Gomory round- 
ing method (Chvatal,1973). These cuts have been shown to be useful, but our experience 
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has shown that the methodology can also be computationally burdensome. Since many 
of these techniques have finite (convergent) algorithms associated with them, the develop- 
ment of computationally efficient, structure-independent cutting planes should be explored 
further. 
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APPENDIX. COMPUTATIONAL RESULTS 



This appendix contains detailed results of the randomly generated generalized assignment 
problem. The composite solution algorithm is coded in C and uses CPLEX 3.0’s callable 
library to solve linear programming relaxations and to branch and bound on the integer 
program as modified by our solution algorithm. All CPU times reported here are from an 
IBM RS-6000 Model 590 with 512 megabytes of random access memory. We allowed a 
maximum of 1000 CPU seconds with optimality criterion of .5%. 



A. STATISTICS 

The following table provides probelm size information for the 84 GAP problems. 



Model Name 


Trucks 


Orders 


Constraints 


Variables 


GAPla-e 


5 


15 


20 


75 


GAP2a-e 


5 


20 


25 


100 


GAP3a-e 


5 


25 


30 


125 


GAP4a-e 


5 


30 


35 


150 


GAP5a-e 


8 


24 


32 


182 


GAP6a-e 


8 


32 


40 


256 


GAP7a-e 


8 


40 


48 


320 


GAP8a-e 


8 


48 


56 


384 


GAP9a-e 


10 


30 


40 


300 


GAPlOa-e 


10 


40 


50 


400 


GAPlla-e 


10 


50 


60 


500 


GAP12a-e 


10 


60 


70 


600 


GAPA1-D1 


5 


100 


105 


500 


GAPA2-D2 


5 


200 


205 


1000 


GAPA3-D3 


10 


100 


110 


1000 


GAPA4-D4 “ 


10 


200 


210 


2000 


GAPA5-D5 


20 


100 


120 


2000 


GAPA6-D6 


20 


200 


220 


4000 



Table 11. GAP problem size. The first 60 GAP problems have been used by I. H. Osman, “Heuristics for the Generalised 
Assignment Problem: Simulated Annealing and Tabu Search Approaches," OR Spektrum, Volume 17, 211-225, (1995), 
and D. Cattrysse, M. Salomon and L. N. Van Wassenhove, “A set partitioning heuristic for the generalized assignmnet 
problem," European Journal of Operational Research, Volume 72, 167-174, (1994). The final 24 problems (GAPA 1 -1)6) 
were used by R C. Chu and J. E. Beasley, “A genetic algorithm for the generalised assignment problem," working paper. 
The Management School, Imperial College, London SW7 2AZ, England (1995). 
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B. RESULTS FOR PROBLEMS WITH LESS THAN 500 VARIABLES 



The first 50 problems presented no challenge for any of the techniques developed in the 
dissertation, to include using only knapsack cuts in conjunction with the branch and bound. 
Note that branch and bound alone could not solve over half of the 50 problems. 



Model 

Name 


BandB 


KS 


ECB 


KS/ECB 


Time 


Nodes 


Time 


Nodes 


Cuts 


Time 


Nodes 


Time 


Nodes 


GAP la 


2.19 


469 


1.98 


24 


16 


1.57 


59 


1.96 


6 


GAP lb 


12.33 


6400 


1.97 


15 


18 


1.88 


216 


2.07 


17 


GAPlc 


2.81 


929 


1.97 


2 


17 


1.58 


62 


2.02 


3 


GAPld 


2.40 


588 


1.90 


6 


13 


1.67 


104 


1.97 


15 


GAPle 


1.73 


159 


1.97 


23 


11 


1.51 


15 


1.94 


2 


GAP2a 


40.95 


33168 


1.96 


4 


18 


1.79 


238 


2.03 


4 


GAP2b 


4.12 


2897 


2.02 


7 


19 


1.58 


82 


2.04 


7 


GAP2c 


14.05 


11483 


2.26 


320 


16 


2.40 


833 


2.08 


71 


GAP2d 


49.74 


37038 


1.86 


6 


10 


1.75 


248 


1.96 


6 


GAP2e 


51.06 


38855 


2.06 


39 


23 


1.68 


197 


2.16 


42 


GAP3a 


4.80 


3045 


2.31 


3 


27 


1.65 


158 


2.37 


3 


GAP3b 


(1000) 


(308K) 


1.98 


11 


16 


1.64 


131 


2.01 


11 


GAP3c 


56.25 


35923 


2.10 


7 


18 


1.56 


51 


2.13 


7 


GAP3d 


57.43 


40139 


2.09 


8 


19 


1.52 


33 


2.16 


8 


GAP3e 


3.18 


1741 


2.21 


6 


17 


1.54 


47 


2.27 


6 


GAP4a 


(1000) 


(282K) 


2.76 


274 


21 


2.05 


422 


2.49 


53 


GAP4b 


(1000) 


(327K) 


3.35 


651 


28 


2.81 


1031 


2.58 


112 


GAP4c 


(1000) 


(322K) 


2.32 


15 


21 


1.64 


125 


2.42 


15 


GAP4d 


2.36 


825 


2.63 


8 


27 


1.55 


56 


2.72 


8 


GAP4e 


(1000) 


(283K) 


2.10 


50 


17 


2.03 


431 


2.12 


8 


GAP5a 


39.39 


24947 


2.00 


5 


16 


1.58 


46 


2.09 


5 


GAP5b 


(1000) 


(469K) 


2.11 


7 


24 


2.18 


439 


2.14 


7 


GAP5c 


(1000) 


(325K) 


1.97 


2 


15 


2.18 


479 


2.02 


2 


GAP5d 


53.02 


37773 


1.83 


0 


12 


1.61 


61 


1.89 


0 


GAP5e 


(1000) 


(440K) 


2.01 


49 


20 


3.35 


1219 


2.07 


40 



Table 12. Problems with less than 500 variables. 
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Model 

Name 


BandB 


KS 


ECB 


KS/ECB 


Time 


Nodes 


Time 


Nodes 


Cuts 


Time 


Nodes 


Time 


Nodes 


GAP6a 


314.45 


109239 


2.27 


66 


28 


2.08 


362 


2.23 


40 


GAP6b 


10.78 


61.09 


1.88 


0 


11 


1.56 


38 


1.95 


0 


GAP6c 


109.20 


56435 


2.26 


6 


25 


1.64 


73 


2.39 


6 


GAP6d 


65.98 


33337 


2.25 


9 


24 


1.73 


133 


2.29 


6 


GAP6e 


(1000) 


(444K) 


2.16 


6 


28 


2.06 


309 


2.26 


4 


GAP7a 


(1000) 


(437K) 


2.47 


85 


20 


1.61 


35 


2.34 


8 


GAP7b 


(1000) 


(348K) 


2.18 


17 


21 


2.07 


274 


2.19 


17 


GAP7c 


(1000) 


(406K) 


1.96 


5 


11 


1.60 


34 


2.01 


5 


GAP7d 


(1000) 


(428K) 


2.10 


63 


19 


1.89 


183 


2.13 


44 


GAP7e 


(1000) 


(430K) 


2.36 


18 


25 


1.70 


84 


2.44 


16 


GAP8a 


(1000) 


(478K) 


2.19 


21 


22 


1.91 


165 


2.17 


21 


GAP 8b 


(1000) 


(474K) 


2.14 


68 


15 


1.81 


90 


2.15 


13 


GAP8c 


(1000) 


(295K) 


2.02 


3 


15 


1.61 


36 


2.07 


3 


GAP8d 


61.98 


27735 


2.06 


3 


13 


1.61 


20 


2.14 


3 


GAP8e 


(1000) 


(41 OK) 


2.13 


31 


21 


1.83 


102 


2.25 


26 


GAP9a 


(1000) 


(42 IK) 


2.13 


62 


21 


16.40 


6988 


2.13 


28 


GAP9b 


(1000) 


(424K) 


2.33 


85 


34 


6.30 


2426 


2.42 


102 


GAP9c 


(1000) 


(370K) 


2.07 


2 


24 


1.86 


174 


2.13 


2 


GAP9d 


(1000) 


(422K) 


2.10 


13 


27 


2.27 


366 


2.16 


11 


GAP9e 


138.70 


62376 


2.11 


7 


17 


1.72 


95 


2.19 


7 


GAP 10a 


(1000) 


(439K) 


2.41 


15 


31 


2.06 


230 


2.48 


15 


GAP 10b 


(1000) 


(462K) 


2.81 


210 


25 


2.52 


397 


2.57 


82 


GAP 10c 


(1000) 


(392K) 


2.26 


15 


25 


18.76 


6804 


2.29 


15 


GAP 1 Od 


(1000) 


(327K) 


2.17 


26 


24 


2.10 


214 


2.27 


21 


GAPlOe 


(1000) 


(426K) 


2.09 


9 


21 


2.54 


359 


2.18 


9 



Table 13. Problems with less than 500 variables. 

C. RESULTS FOR PROBLEMS WITH 500 AND 600 VARIABLES 



These problems began to challenge the techniques and the computer memory. In a few cases 
(GAPA1 and GAPD 1 ), the time required to generate cuts is significant, causing solution time 
to increase. The large number of nodes required by ECB to solve GAPllc and GAPlle 
mark them as candidates for nested ECB. GAP12c and GAPD1 are the first two instances 
where the computer terminated the solution process prematurely. In both cases, there was 
insufficient memory to keep the extensive data required by the branch-and-bound process. 
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Model 

Name 


BandB 


KS 


ECB 


KS/ECB 


Time 


Nodes 


Time 


Nodes 


Cuts 


lime 


Nodes 


Time 


Nodes 


GAPlla 


172.81 


59274 


2.84 


98 


32 


2.21 


225 


2.77 


25 


GAPllb 


(1000) 


(304K) 


2.18 


19 


19 


1.99 


124 


2.31 


30 


GAPllc 


(1000) 


(364K) 


2.71 


19 


30 


56.79 


15423 


2.70 


19 


GAPlld 


830.71 


192307 


2.86 


182 


25 


2.30 


255 


2.47 


22 


GAPlle 


(1000) 


(39 IK) 


73.02 


18892 


43 


61.26 


18999 


4.28 


299 


GAP 12a 


(1000) 


(304K) 


2.99 


11 


39 


3.14 


460 


3.08 


21 


GAP 12b 


(1000) 


(304K) 


3.98 


349 


30 


2.57 


272 


3.06 


25 


GAP 12c 


(983.62) 


(304K) 


3.20 


43 


34 


4.52 


810 


3.26 


34 


GAP 1 2d 


(1000) 


(304K) 


3.56 


36 


43 


2.91 


390 


3.56 


35 


GAP12e 


(1000) 


(304K) 


2.34 


11 


26 


1.76 


44 


2.52 


22 


GAPA1 


190.48 


64588 


19.03 


2609 


24 


1.89 


109 


10.24 


122 


GAPB1 


(1000) 


(311 K) 


9.16 


519 


27 


2.50 


363 


7.81 


88 


GAPC1 


(1000) 


(326K) 


17.34 


3665 


21 


5.85 


1172 


6.65 


416 


GAPD1 


(737.51) 


(295 K) 


22.73 


0 


13 


1.62 


16 


22.61 


. 0 



Table 14. Problems with 500 and 600 variables. 

D. RESULTS FOR PROBLEMS WITH 1000 VARIABLES 



Solving with knapsack cuts and branch and bound becomes increasingly difficult. ECB 
does well with the exception of GAPC3, which it cannot solve, making it a candidate for 
nested ECB. Cut generation time is significant, making ECB alone quicker in many cases, 
even when using more nodes in branch and bound. Two problems (GAPD2 and GAPD3) 
terminated early due to an unrecoverable failure during the branch-and-bound process. 



Model 

Name 


BandB 


KS 


ECB 


KS/ECB 


Time 


Nodes 


Time 


Nodes 


Cuts 


Time 


Nodes 


Time 


Nodes 


GAPA2 


428.03 


104332 


82.19 


1806 


24 


2.12 


92 


74.54 


104 


GAPB2 


70.76 


16845 


45.38 


1342 


34 


2.82 


184 


38.31 


240 


GAPC2 


33.18 


7692 


33.64 


1373 


19 


3.27 


269 


26.14 


260 


GAPD2 


(506.52) 


(126K) 


484.44 


8 


29 


1.84 


20 


482.71 


8 


GAPA3 


(1000) 


(22 IK) 


18.79 


866 


53 


2.22 


102 


14.44 


160 


GAPB3 


(1000) 


(26 IK) 


40.84 


5297 


25 


2.21 


96 


4.28 


25 


GAPC3 


(1000) 


(25 IK) 


142.75 


15681 


56 


(1000) 


(162K) 


20.07 


1311 


GAPD3 


(805.84) 


(207K) 


19.69 


8 


39 


1.95 


43 


19.75 


8 



Table 15. Problems with 1000 variables. 
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E. 



RESULTS FOR PROBLEMS WITH 2000 VARIABLES 



Solving with knapsack cuts and branch and bound becomes still more difficult, and GAPB5 
cannot be solved with knapsack cuts and branch and bound. ECB does well with the excep- 
tion of GAPA5, which ECB cannot solve, and GAPC5, which requires over 20,000 nodes. 
Both are candidates for nested ECB. Again, cut generation time is significant. Two more 
problems (GAPC4 and GAPD5) terminated early due to an unrecoverable failure during the 
branch-and-bound process. 



Model 

Name 


BandB 


KS 


ECB 


KS/ECB 


Time 


Nodes 


Time 


Nodes 


Cuts 


Time 


Nodes 


Time 


Nodes 


GAPA4 


40.07 


5388 


35.51 


527 


42 


5.08 


320 


33.10 


202 


GAPB4 


(1000) 


(145K) 


48.99 


2990 


25 


3.35 


147 


11.77 


127 


GAPC4 


(977.59) 


(133K) 


42.96 


1760 


43 


3.91 


224 


24.76 


37 


GAPD4 


661.91 


94401 


140.75 


223 


32 


2.46 


49 


139.86 


36 


GAPA5 


(1000) 


(147K) 


389.71 


17879 


90 


(1000) 


(89K) 


293.70 


9621 


GAPB5 


(1000) 


(144K) 


(1000) 


(57K) 


57 


36.52 


1913 


44.13 


1337 


GAPC5 


(1000) 


(146K) 


229.26 


9787 


75 


277.36 


22677 


8.62 


178 


GAPD5 


(949.12) 


(139K) 


6.46 


30 


43 


2.82 


95 


6.40 


15 



Table 16. Problems with 2000 variables. 



F. RESULTS FOR PROBLEMS WITH 4000 VARIABLES 

Solving with knapsack cuts and branch and bound nearly impossible. GAPA6, GAPB6, and 
GAPC6 cannot be solved in 1 000 CPU seconds with knapsack cuts. ECB does exceptionally 
well. Knapsack cuts and ECB combined take fewer nodes than ECB alone in every case. 



but more CPU time as cut generation time increases. 



Model 

Name 


BandB 


KS 


ECB 


KS/ECB 


Time 


Nodes 


Time 


Nodes 


Cuts 


Time 


Nodes 


Time 


Nodes 


GAPA6 


(1000) 


(76K) 


(1000) 


(56K) 


64 


9.03 


454 


33.52 


387 


GAPB6 


880.84 


66861 


(1000) 


(52K) 


84 


29.22 


694 


39.21 


152 


GAPC6 


(1000) 


(76K) 


(1000) 


(46K) 


69 


87.28 


1244 


39.09 


199 


GAPD6 


(1000) 


(75K) 


47.17 


125 


62 


4.21 


109 


47.53 


66 



Table 1 7. Problems with 4000 variables. 



These problems are so large that the number of branch-and-bound nodes that can be transited 
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in 1000 CPU seconds is much fewer than the mid-sized problems, which possibly explains 
why there were no premature terminations of the solution process for these problems. 
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